-- Logs begin at Wed 2021-02-17 03:50:06 UTC, end at Wed 2021-02-17 05:00:08 UTC. -- Feb 17 04:27:07.399084 dv-cinder-760197-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Feb 17 04:27:07.406712 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Feb 17 04:27:07.408841 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: *** Starting uWSGI 2.0.15-debian (64bit) on [Wed Feb 17 04:27:07 2021] *** Feb 17 04:27:07.408841 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: compiled with version: 7.3.0 on 28 September 2018 15:41:15 Feb 17 04:27:07.408841 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: os: Linux-4.15.0-55-generic #60-Ubuntu SMP Tue Jul 2 18:22:20 UTC 2019 Feb 17 04:27:07.408841 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: nodename: dv-cinder-760197-3-iscsi Feb 17 04:27:07.408841 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: machine: x86_64 Feb 17 04:27:07.408841 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: clock source: unix Feb 17 04:27:07.408841 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: pcre jit disabled Feb 17 04:27:07.408841 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: detected number of CPU cores: 4 Feb 17 04:27:07.408841 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: current working directory: / Feb 17 04:27:07.408841 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: detected binary path: /usr/bin/uwsgi-core Feb 17 04:27:07.408841 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: dropping root privileges as early as possible Feb 17 04:27:07.410282 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: your processes number limit is 47843 Feb 17 04:27:07.410282 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: your memory page size is 4096 bytes Feb 17 04:27:07.410282 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: detected max file descriptor number: 2048 Feb 17 04:27:07.410282 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: lock engine: pthread robust mutexes Feb 17 04:27:07.410282 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: thunder lock: enabled Feb 17 04:27:07.410282 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Feb 17 04:27:07.410282 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: dropping root privileges after socket binding Feb 17 04:27:07.410282 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: Python version: 3.6.9 (default, Oct 8 2020, 12:12:24) [GCC 8.4.0] Feb 17 04:27:07.454596 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: Python main interpreter initialized at 0x5584178669c0 Feb 17 04:27:07.454596 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: dropping root privileges after plugin initialization Feb 17 04:27:07.454596 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: python threads support enabled Feb 17 04:27:07.454596 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: your server socket listen backlog is limited to 100 connections Feb 17 04:27:07.454596 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: your mercy for graceful operations on workers is 90 seconds Feb 17 04:27:07.455051 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: mapped 402621 bytes (393 KB) for 2 cores Feb 17 04:27:07.455051 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: *** Operational MODE: preforking *** Feb 17 04:27:07.455230 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: dropping root privileges after application loading Feb 17 04:27:07.455230 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: *** uWSGI is running in multiple interpreter mode *** Feb 17 04:27:07.455230 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: spawned uWSGI master process (pid: 83219) Feb 17 04:27:07.455402 dv-cinder-760197-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Feb 17 04:27:07.456363 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: spawned uWSGI worker 1 (pid: 83220, cores: 1) Feb 17 04:27:07.456363 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: spawned uWSGI worker 2 (pid: 83221, cores: 1) Feb 17 04:27:07.456363 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Feb 17 04:27:11.914156 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Feb 17 04:27:11.914784 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Feb 17 04:27:11.916045 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Feb 17 04:27:11.916482 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Feb 17 04:27:11.916778 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Feb 17 04:27:11.917244 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.917732 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.917981 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.918347 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.918753 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.918974 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Feb 17 04:27:11.919108 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.919282 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Feb 17 04:27:11.919469 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.919829 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.920205 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.920503 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.920859 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Feb 17 04:27:11.920969 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.921209 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-760197-3-iscsi {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.921330 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Feb 17 04:27:11.921540 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Feb 17 04:27:11.921636 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.921900 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.922005 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.922256 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.922364 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.922645 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.922744 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.922993 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.923090 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.923367 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.923463 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.923715 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.923810 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.924104 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.924330 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.924502 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.924684 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.924820 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.925077 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.925230 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.925431 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.925528 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.925818 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.925921 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-760197-3-iscsi {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.926176 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.926271 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.926524 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.926701 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.926905 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.927021 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.927250 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.927354 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.927594 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.927691 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.927951 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.928059 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.928293 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.928395 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-760197-3-iscsi {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.928656 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.928910 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.929023 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.929262 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.929364 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.929612 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.929805 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.929968 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.930159 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.930357 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.930510 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.930737 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.930910 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.931090 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.931282 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.931461 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.931632 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.931813 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.932013 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.932183 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.932383 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.932540 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.932753 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.932910 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-760197-3-iscsi {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.933124 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.933256 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.933466 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.933573 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.934060 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.934166 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.934418 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.934665 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.934787 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.935022 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.935120 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.935374 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.935472 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.935711 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.935814 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.936062 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.936160 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.936412 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.936514 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.936776 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.936880 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.937139 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.937241 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.937422 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.937530 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.937711 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.937849 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.938086 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.938183 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.938463 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.938595 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.938844 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.938948 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.939194 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.939292 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.939534 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.939632 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.939874 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.939970 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.940155 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.940260 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.940505 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.941377 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.941377 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.941540 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.941692 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.941879 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.942038 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.942260 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.942403 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.942557 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.942802 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.942902 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.943158 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.943304 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.943520 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.943616 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.943900 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.943997 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.38 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.944242 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.38 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.944339 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.944584 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.944716 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.944933 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.945051 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.945282 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.945397 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.945630 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.945758 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.945982 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.946097 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.946329 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.946457 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.950632 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.950823 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.950981 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.951130 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.951232 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.951326 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.951419 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.951524 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.951619 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.951717 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.951818 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.951918 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.38 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.952022 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.952116 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.38 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.952213 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.952305 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.952397 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.952488 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.952587 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.952680 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.952772 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.952863 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.952960 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.953053 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.953155 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.953248 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.953341 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.953432 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.953524 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.953597 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.953675 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.953771 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.953869 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.953969 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.954062 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.954158 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.954258 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.954355 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.954453 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.954553 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.954681 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.954785 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.954881 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.954972 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.955063 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.955153 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.955244 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.955342 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.955440 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.955532 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.955624 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.955714 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.955805 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.955902 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.956002 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.956094 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.956197 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.956841 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.956921 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.957025 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.957102 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.957341 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.957461 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.957689 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.957797 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.958038 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.958132 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.958380 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.958473 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.958749 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.958863 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.959098 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.959191 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.959437 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.959535 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.959804 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.959904 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.960146 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.960238 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.960485 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.960577 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.960825 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.960927 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.961147 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.961242 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.961496 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.961595 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.961840 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.961944 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.962183 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.962277 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.962531 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.962651 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.962898 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.962992 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.963237 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.963329 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.963590 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.963692 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.963901 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.964000 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.964238 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.964331 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.964586 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.964681 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.964923 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.965016 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.965264 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.965357 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.965611 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.965702 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.965951 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.966043 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.966297 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.966395 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.966665 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.966770 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.967012 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.967105 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.967359 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.967458 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.967700 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.967802 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.968025 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.968124 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.968368 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.968463 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.968706 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.968806 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.969074 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.969171 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.969443 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.969536 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.969789 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.969889 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.970136 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.970234 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.970475 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.970592 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.970858 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.970951 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:27:11.971287 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.971388 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.971594 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.971687 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.972001 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.972155 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.972436 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.972681 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.972838 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.973126 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.973282 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.973425 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.973565 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.973804 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.973955 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.974096 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.974254 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.974404 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.974546 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.974715 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.974858 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.975084 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.975239 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.975381 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.975527 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.975668 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.975816 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.975959 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.976158 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.976308 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.976530 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.976687 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.976885 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.977035 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.977238 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.977388 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.977586 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.977758 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.977974 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.978122 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.978270 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.978420 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.978596 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.978762 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.978973 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.979130 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.979326 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.979481 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.979684 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.979843 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.980034 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.980183 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.980381 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.980529 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.980730 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.980888 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.981077 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.981228 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.981475 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.981624 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.981767 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.981908 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.982103 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.982254 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.982456 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.982637 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.982865 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.983023 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.983171 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.983325 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.983475 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.983618 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.983843 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.984006 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.984148 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.984299 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.984495 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.984644 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.984835 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.984984 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.985176 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.985332 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.985483 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.985625 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.985842 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.985991 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.986191 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.986350 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.986551 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.986721 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.986924 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.987073 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.987853 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.988108 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.988267 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.988413 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.988559 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.988712 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.988865 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.989009 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.989153 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.989296 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.989440 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.989600 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.989759 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.989905 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.990085 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.990228 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.990376 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.990537 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.990734 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.990878 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.991022 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.991165 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.991308 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.991497 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.991651 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.991810 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.991976 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.992119 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.992269 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.992412 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.992573 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.992723 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.992884 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.993095 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.993203 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.993297 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.993389 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.993486 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.993584 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.993677 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.993856 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.994023 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.994209 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.994307 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.994611 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.994712 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.994960 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.995058 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.995310 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.995405 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.995679 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.995782 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.996026 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.996128 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.996372 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.996468 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.996711 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.996876 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.997049 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.997150 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.997389 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.997485 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.997740 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.997843 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.998089 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.998230 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.998442 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.998546 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.998813 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.998923 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.999165 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.999262 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.999514 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.999616 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.999855 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:11.999957 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.000197 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.000304 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.000542 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.000644 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.000907 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.001056 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.001222 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.001325 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.001568 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.001707 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.001908 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.002011 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.002256 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.002352 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.002643 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.002748 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.003027 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.003688 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.003892 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.003999 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.004266 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.004362 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.004627 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.004724 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.004983 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.005079 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.005331 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.005434 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.005670 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.005766 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.006013 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.006113 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.006364 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.006466 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.006728 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.006826 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.007085 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.007180 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.007431 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.007538 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.007779 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.007875 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.008128 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.008223 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.008495 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.008602 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.008843 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.008938 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.009184 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.009281 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.009534 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.009642 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.009878 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.009973 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.010230 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.010375 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.010617 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.010734 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.010955 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.011050 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.011305 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.011405 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.011648 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.011771 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.011997 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.012093 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.012348 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.012443 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.012698 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.012794 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.013041 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.013137 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.013386 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.013481 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.013733 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.013829 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.014083 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.014179 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.014433 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.014542 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.014802 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.014900 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.015215 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.015323 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.015515 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.015619 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.015865 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.015967 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.016225 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.016320 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.016567 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.016673 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.016915 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.017011 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.017282 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.017377 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.017633 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.017738 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.017974 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.018070 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.018324 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.018420 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.018762 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.018884 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.019181 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.019326 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.019541 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.019714 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.019891 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.020094 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.020253 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.020474 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.020622 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.020794 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.020976 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.021150 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.021334 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.021502 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.021690 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.021855 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.022044 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.022218 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.022414 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.022822 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.022933 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.023176 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.023315 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.023530 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.023677 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.023889 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.024020 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.024243 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.024359 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.024596 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.024709 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.024969 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.025065 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.025324 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.025421 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.025676 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.025778 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.026026 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.026122 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.026374 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.026477 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.026751 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.026851 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.027096 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.027194 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.027455 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.027781 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.027877 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.028127 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.028228 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.028484 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.028588 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.028839 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.028940 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.029187 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.029282 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.029536 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.029633 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.029884 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.029980 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.030234 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.030329 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.030607 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.030709 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.030939 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.031036 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.031285 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.031380 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.031626 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.031722 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.031964 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.032059 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.032318 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.032413 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.032657 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.032754 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.032999 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.033094 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.033339 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.033434 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.033684 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.033781 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.034029 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.034139 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.034452 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.034594 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.034860 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.034972 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.035210 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.035318 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.035566 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.035673 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.035914 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.036009 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.036268 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.036365 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.036614 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.036718 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.036965 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.037061 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.037312 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.037408 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.037657 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.037759 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.037996 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.038098 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.038343 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.038438 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.038734 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.038864 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.039082 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.039214 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.039420 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.039520 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.039776 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.039876 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.040122 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.040219 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.040485 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.040601 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.040837 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.040948 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.041174 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.041272 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.041520 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.041617 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.041858 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.041956 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.042205 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.042315 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.042549 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.042662 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.042912 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.043012 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.043264 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.043361 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.043604 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.043712 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.043951 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.044050 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.044291 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.044398 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.044636 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.044745 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.044981 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.045089 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.045342 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.045450 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.045689 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.045804 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.046028 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.046141 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.046364 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.046472 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.046728 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.046846 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.047071 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.047168 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.047412 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.047510 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.047766 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.047870 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.048111 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.048208 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.048448 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.048545 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.048789 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.048892 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.049128 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.049219 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.049467 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.049574 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.049811 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.050415 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.050776 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.050913 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.051125 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.051233 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.051476 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.051582 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.051828 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.051925 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.052225 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.052346 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.052568 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.052677 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.052908 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.053014 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.053265 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.053379 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.053613 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.053720 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.053960 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.054113 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.054340 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.054499 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.054685 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.054830 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.054987 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.055145 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.055289 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.055439 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.055632 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.055782 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.055938 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.056081 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.056290 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.056449 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.056606 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.056750 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.056989 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.057141 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.057299 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.057456 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.057685 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.057831 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.058033 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.058179 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.058390 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.058488 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.058760 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.059110 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.059366 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.059488 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.059711 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.059810 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.060059 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.060156 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.060406 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.060502 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.060752 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.060854 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.061093 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.061290 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.061438 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.061541 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.061782 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.061879 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.062130 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.062226 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.062474 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.062660 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.062850 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.062974 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.063205 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.063301 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.063559 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.063716 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.063899 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.063995 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.064252 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.064361 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.064601 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.064772 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.064932 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.065030 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.065279 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.065376 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.065662 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.065840 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.066006 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.066150 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.066369 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.066516 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.066748 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.067064 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.067169 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.067421 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.067518 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.067765 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.067870 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.068106 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.068202 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.068454 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.068551 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.068801 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.068903 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.069160 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.069257 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.069509 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.069619 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.069847 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.069965 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.070192 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.070334 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.070539 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.070736 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.070913 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.071053 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.071261 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.071388 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.071774 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.071992 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.072258 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.072526 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.072734 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.072814 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.072814 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.072946 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.073070 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.073399 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.073493 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.073753 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.073832 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.074655 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.074782 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.074782 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.074924 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.074924 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.075073 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.075140 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.075411 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.075602 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.075766 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.075962 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.076160 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.076301 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.076449 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.076777 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.076888 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.077124 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.077229 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.077472 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.077577 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.077820 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.077917 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.078168 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.078265 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.078515 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.078648 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.078887 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.078994 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.079237 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.079334 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.079587 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.079685 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.079961 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.080058 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.080335 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.080432 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.080690 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.080788 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.081051 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.081147 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.082114 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.082230 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.082472 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.082604 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.082875 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.082983 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.083231 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.083340 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.083603 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.083702 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.083955 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.084059 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.084315 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.084422 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.084669 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.084753 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.085044 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.085147 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.085419 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.085523 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.085764 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.085861 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.086112 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.086208 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.086454 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.086600 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.086825 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.086932 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.087174 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.087270 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.087534 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.087632 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.087877 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.087972 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.088232 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.088327 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.088586 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.088684 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.088941 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.089044 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.089288 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.089383 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.089643 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.089740 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.090012 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.090108 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.090362 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.090459 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.090744 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.090858 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.091094 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.091191 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.091445 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.091552 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.091812 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.091894 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.092154 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.092261 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.092507 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.092611 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.092854 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.092961 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.093202 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.093300 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.093539 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.093643 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.093881 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.093978 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.094245 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.094342 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.094612 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.094725 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.094975 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.095083 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.095325 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.095429 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.095698 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.095803 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.096045 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.096141 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.096393 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.096490 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.096765 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.097545 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.097645 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.097738 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.097996 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.098094 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.098358 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.098464 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.098726 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.098836 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.099073 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.099176 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.099436 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.099533 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.099784 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.099880 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.100132 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.100229 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.100482 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.100592 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.100836 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.100933 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.101183 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.101287 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.101530 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.101650 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.101878 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.101976 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.102235 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.102343 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.102587 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.102700 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.102960 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.103056 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.103308 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.103404 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.103651 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.103756 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.103992 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.104089 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.104334 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.104436 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.104675 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.104773 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.105029 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.105133 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.105376 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.105474 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.105723 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.105828 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.106072 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.106176 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.106438 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.106535 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.106808 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.106909 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.107176 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.107273 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.107525 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.107633 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.107873 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.107970 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.108222 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.108319 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.108572 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.108676 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.108931 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.109029 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.109283 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.109380 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.109644 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.109747 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.109998 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.110108 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.110358 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.110461 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.110742 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.110844 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.111092 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.111190 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.111465 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.111686 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.111797 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.112067 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.112150 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.112574 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.driver = filter_scheduler {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.112689 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.112837 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.112947 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.113199 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.113311 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.113557 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.113655 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.113921 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.114025 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.114278 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.114377 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.114658 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.periodic_task_interval = 60 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.114759 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.115014 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.115159 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.115365 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.115496 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.115720 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.115957 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.116076 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.116331 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.116440 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.116712 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.driver = filter_scheduler {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.116826 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.117073 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.117188 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.117431 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.117538 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.117789 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.117895 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.118153 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.118260 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.118509 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.118647 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.118890 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.periodic_task_interval = 60 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.118998 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.119246 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.119354 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.119603 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.119709 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.119959 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.120079 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.120328 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.120428 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.120696 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.120794 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.121048 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.121154 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.121408 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.121506 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.121765 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.121867 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.122115 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.122248 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.122469 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.122619 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.122853 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.122953 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.123202 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.123309 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.123560 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.123664 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.123931 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.124029 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.124295 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.124393 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.124651 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.124748 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.125007 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.125104 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.125357 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.125459 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.125706 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.125804 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.126062 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.126294 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.126400 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.126676 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.126778 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.127058 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.127165 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.127433 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.127538 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.127783 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.127882 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.128165 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.128268 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.128562 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.128661 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.128952 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.129050 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.129302 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.129400 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.129653 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.129751 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.130001 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.130132 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.130355 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.130599 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.130752 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.130974 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.131078 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.131359 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.131456 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.131738 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.131836 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.132096 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.132199 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.132451 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.132561 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.132815 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.133056 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.133155 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.133461 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.133561 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.133821 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.133926 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.134177 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.134282 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.134531 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.134698 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.134903 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.135012 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.135246 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.135387 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.135595 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.135699 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.135943 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.136042 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.136291 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.136388 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.136638 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.136734 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.136985 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.137253 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.137352 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.137651 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.137756 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.138006 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.138110 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.138360 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.138457 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.138732 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.138845 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.139088 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.139197 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.139435 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.139534 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.139800 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.139897 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.140144 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.140287 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.140484 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.140589 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.140834 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.140931 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.141181 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.141279 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.141520 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.141617 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.141860 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.141963 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.142201 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.142299 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.142547 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.142667 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.142920 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.143018 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.143261 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.143398 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.143599 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.144776 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.144776 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.144951 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.145059 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.145154 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.145253 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.145347 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.145564 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.145681 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.145906 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.146004 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.146249 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.146349 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.146623 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.146738 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.146967 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.147065 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.147308 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.147406 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.147657 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.147761 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.147996 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.148094 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.148347 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.148445 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.148694 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.148798 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.149043 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.149140 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.149387 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.149486 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.149739 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.150006 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.150124 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.150388 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.150500 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.150778 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.150900 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.151126 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.151226 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.151485 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.151583 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.151841 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.151950 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.152204 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.152302 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.152554 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.152653 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.152903 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.153009 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.153253 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.153358 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.153611 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.153715 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.153964 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.154232 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.154332 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.154667 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.154771 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.155022 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.155131 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.155377 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.155476 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.155734 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.155836 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.156086 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.156192 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.156431 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.156529 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.156780 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.156877 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.157145 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.157254 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.157498 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.157596 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.157846 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.157945 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.158199 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.158358 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.158548 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.158689 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.158922 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.159027 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.159268 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.159407 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.160166 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.160272 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.160531 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.160646 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.160882 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.160982 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.161240 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.161394 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.161586 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.161701 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.161973 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.162082 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.162335 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.162450 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.162722 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.162843 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.163093 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.163218 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.163443 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.163565 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.163798 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.163914 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.164151 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.164285 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.164504 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.164602 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.164862 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.164982 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.165212 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.165310 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.165561 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.165683 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.165905 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.166020 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.166251 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.166672 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.167064 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.167298 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.167458 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.167678 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.167776 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.168059 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.168167 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.168438 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.168542 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.168785 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.168883 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.169146 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.169244 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.169502 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.169609 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.169858 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.169971 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.170222 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.170324 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.170595 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.170693 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.170959 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.171078 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.171308 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.171410 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.171663 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.171761 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.172013 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.172110 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.172376 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.172474 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.172724 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.172822 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.173084 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.173182 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.173438 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.173535 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.173799 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.173896 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.174150 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.174247 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.174508 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.174636 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.174890 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.175181 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.175284 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.175378 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.175636 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.175739 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.175987 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.176095 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.176348 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.176447 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.176706 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.176821 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.177060 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.177157 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.177409 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.177512 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.177775 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.177878 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.178123 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.178221 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.178478 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.178611 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.178860 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.179224 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.179613 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.179711 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.179974 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.180070 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.180351 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.180462 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.180707 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.180803 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.181079 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.181176 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.181437 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.181541 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.181790 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.181888 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.182157 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.182254 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.182520 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.182649 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.182898 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.182996 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.183258 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.183355 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.183613 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.183718 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.184221 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.184324 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.184576 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.184682 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.184925 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.185024 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.185277 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.185373 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.185623 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.185728 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.185979 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.186083 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.186345 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.186446 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.186713 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.186830 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.187091 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.187194 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.187453 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.187551 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.187818 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.187926 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.188179 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.188276 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.188533 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.188631 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.188912 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.189016 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.189266 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.189369 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.189549 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=83220) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Feb 17 04:27:12.189647 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.189949 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.190301 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.190740 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.191106 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.191477 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.191853 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.192228 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.192602 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.193006 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.193364 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.193756 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.194137 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:27:12.194422 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=83221) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Feb 17 04:27:12.303519 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG oslo_db.sqlalchemy.engines [None req-40ffdb29-eddc-492f-975d-3e7256357d3f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=83220) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 17 04:27:12.308148 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG oslo_db.sqlalchemy.engines [None req-c8b527da-ce4d-4dda-9d25-88ceecc19ddf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=83221) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 17 04:27:12.565181 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.context [None req-40ffdb29-eddc-492f-975d-3e7256357d3f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cae8762b-f9db-4634-9f99-cd5d65b514f3(cell1) {{(pid=83220) load_cells /opt/stack/nova/nova/context.py:466}} Feb 17 04:27:12.570401 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.context [None req-c8b527da-ce4d-4dda-9d25-88ceecc19ddf None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cae8762b-f9db-4634-9f99-cd5d65b514f3(cell1) {{(pid=83221) load_cells /opt/stack/nova/nova/context.py:466}} Feb 17 04:27:12.571386 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG oslo_concurrency.lockutils [None req-40ffdb29-eddc-492f-975d-3e7256357d3f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83220) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:27:12.573222 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG oslo_concurrency.lockutils [None req-40ffdb29-eddc-492f-975d-3e7256357d3f None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=83220) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:27:12.574100 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG oslo_concurrency.lockutils [None req-40ffdb29-eddc-492f-975d-3e7256357d3f None None] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83220) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:27:12.575842 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG oslo_concurrency.lockutils [None req-c8b527da-ce4d-4dda-9d25-88ceecc19ddf None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:27:12.576238 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG oslo_concurrency.lockutils [None req-40ffdb29-eddc-492f-975d-3e7256357d3f None None] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=83220) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:27:12.577676 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG oslo_concurrency.lockutils [None req-c8b527da-ce4d-4dda-9d25-88ceecc19ddf None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=83221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:27:12.578546 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG oslo_concurrency.lockutils [None req-c8b527da-ce4d-4dda-9d25-88ceecc19ddf None None] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:27:12.580693 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG oslo_concurrency.lockutils [None req-c8b527da-ce4d-4dda-9d25-88ceecc19ddf None None] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=83221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:27:12.604871 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG oslo_db.sqlalchemy.engines [None req-40ffdb29-eddc-492f-975d-3e7256357d3f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=83220) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 17 04:27:12.607409 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG oslo_db.sqlalchemy.engines [None req-c8b527da-ce4d-4dda-9d25-88ceecc19ddf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=83221) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 17 04:27:12.610416 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG oslo_db.sqlalchemy.engines [None req-c8b527da-ce4d-4dda-9d25-88ceecc19ddf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=83221) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 17 04:27:12.613868 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG oslo_db.sqlalchemy.engines [None req-40ffdb29-eddc-492f-975d-3e7256357d3f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=83220) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 17 04:27:12.639516 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG oslo_db.sqlalchemy.engines [None req-40ffdb29-eddc-492f-975d-3e7256357d3f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=83220) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 17 04:27:12.641774 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG oslo_db.sqlalchemy.engines [None req-c8b527da-ce4d-4dda-9d25-88ceecc19ddf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=83221) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 17 04:27:12.737992 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 17 04:27:12.737992 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: from cryptography.utils import int_from_bytes Feb 17 04:27:12.738299 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 17 04:27:12.738299 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: from cryptography.utils import int_from_bytes Feb 17 04:27:12.738465 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 17 04:27:12.738465 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: from cryptography.utils import int_from_bytes Feb 17 04:27:12.738721 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 17 04:27:12.738721 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: from cryptography.utils import int_from_bytes Feb 17 04:27:12.815104 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: INFO keyring.backend [None req-c8b527da-ce4d-4dda-9d25-88ceecc19ddf None None] Loading Gnome Feb 17 04:27:12.816587 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: INFO keyring.backend [None req-40ffdb29-eddc-492f-975d-3e7256357d3f None None] Loading Gnome Feb 17 04:27:12.835621 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: INFO keyring.backend [None req-c8b527da-ce4d-4dda-9d25-88ceecc19ddf None None] Loading Google Feb 17 04:27:12.836769 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: INFO keyring.backend [None req-40ffdb29-eddc-492f-975d-3e7256357d3f None None] Loading Google Feb 17 04:27:12.839010 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: INFO keyring.backend [None req-c8b527da-ce4d-4dda-9d25-88ceecc19ddf None None] Loading Windows (alt) Feb 17 04:27:12.840038 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: INFO keyring.backend [None req-40ffdb29-eddc-492f-975d-3e7256357d3f None None] Loading Windows (alt) Feb 17 04:27:12.843482 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: INFO keyring.backend [None req-c8b527da-ce4d-4dda-9d25-88ceecc19ddf None None] Loading file Feb 17 04:27:12.844692 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: INFO keyring.backend [None req-40ffdb29-eddc-492f-975d-3e7256357d3f None None] Loading file Feb 17 04:27:12.845023 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: INFO keyring.backend [None req-c8b527da-ce4d-4dda-9d25-88ceecc19ddf None None] Loading keyczar Feb 17 04:27:12.845242 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: INFO keyring.backend [None req-c8b527da-ce4d-4dda-9d25-88ceecc19ddf None None] Loading multi Feb 17 04:27:12.845979 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: INFO keyring.backend [None req-40ffdb29-eddc-492f-975d-3e7256357d3f None None] Loading keyczar Feb 17 04:27:12.846331 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: INFO keyring.backend [None req-c8b527da-ce4d-4dda-9d25-88ceecc19ddf None None] Loading pyfs Feb 17 04:27:12.846435 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: INFO keyring.backend [None req-40ffdb29-eddc-492f-975d-3e7256357d3f None None] Loading multi Feb 17 04:27:12.847495 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: INFO keyring.backend [None req-40ffdb29-eddc-492f-975d-3e7256357d3f None None] Loading pyfs Feb 17 04:27:13.125572 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: WARNING keystonemiddleware.auth_token [None req-c8b527da-ce4d-4dda-9d25-88ceecc19ddf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 17 04:27:13.133401 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: WARNING keystonemiddleware.auth_token [None req-c8b527da-ce4d-4dda-9d25-88ceecc19ddf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 17 04:27:13.140222 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: WARNING keystonemiddleware.auth_token [None req-40ffdb29-eddc-492f-975d-3e7256357d3f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 17 04:27:13.150107 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: WARNING keystonemiddleware.auth_token [None req-40ffdb29-eddc-492f-975d-3e7256357d3f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 17 04:27:13.502406 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: WARNING keystonemiddleware.auth_token [None req-c8b527da-ce4d-4dda-9d25-88ceecc19ddf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 17 04:27:13.509235 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: WARNING keystonemiddleware.auth_token [None req-c8b527da-ce4d-4dda-9d25-88ceecc19ddf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 17 04:27:13.515084 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5584178669c0 pid: 83221 (default app) Feb 17 04:27:13.517290 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi [None req-c8b527da-ce4d-4dda-9d25-88ceecc19ddf None None] Calling method '>' {{(pid=83221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:27:13.518658 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: WARNING keystonemiddleware.auth_token [None req-40ffdb29-eddc-492f-975d-3e7256357d3f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 17 04:27:13.519311 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: INFO nova.api.openstack.requestlog [None req-c8b527da-ce4d-4dda-9d25-88ceecc19ddf None None] 10.222.0.38 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001851 Feb 17 04:27:13.521637 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: [pid: 83221|app: 0|req: 1/1] 10.222.0.38 () {50 vars in 779 bytes} [Wed Feb 17 04:27:13 2021] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:27:13.527975 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: WARNING keystonemiddleware.auth_token [None req-40ffdb29-eddc-492f-975d-3e7256357d3f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 17 04:27:13.534645 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5584178669c0 pid: 83220 (default app) Feb 17 04:28:38.888526 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi [None req-2475e8cd-5ec3-4af9-9d4c-58d5abc15ecc admin admin] Calling method '>' {{(pid=83221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:28:38.914937 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: INFO nova.api.openstack.requestlog [None req-2475e8cd-5ec3-4af9-9d4c-58d5abc15ecc admin admin] 10.222.0.38 "GET /compute/v2.1/flavors/detail" status: 200 len: 15 microversion: 2.1 time: 0.499409 Feb 17 04:28:38.915553 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: [pid: 83221|app: 0|req: 2/2] 10.222.0.38 () {58 vars in 1150 bytes} [Wed Feb 17 04:28:38 2021] GET /compute/v2.1/flavors/detail => generated 15 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:28:41.774663 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi [None req-e17766b3-aab8-49ed-aa00-c2b2eb0cb5b5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "ram": 256, "vcpus": 1, "disk": 1, "id": "c1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:28:41.800018 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:28:41.800018 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: warnings.warn(msg) Feb 17 04:28:41.826966 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: INFO nova.api.openstack.requestlog [None req-e17766b3-aab8-49ed-aa00-c2b2eb0cb5b5 admin admin] 10.222.0.38 "POST /compute/v2.1/flavors" status: 200 len: 367 microversion: 2.1 time: 0.394837 Feb 17 04:28:41.827720 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: [pid: 83220|app: 0|req: 1/3] 10.222.0.38 () {62 vars in 1183 bytes} [Wed Feb 17 04:28:41 2021] POST /compute/v2.1/flavors => generated 367 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:28:41.838788 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi [None req-ba55c2e4-acbb-47aa-822e-8a9bae225291 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:28:41.840913 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:28:41.840913 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: warnings.warn(msg) Feb 17 04:28:41.879515 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: INFO nova.api.openstack.requestlog [None req-ba55c2e4-acbb-47aa-822e-8a9bae225291 admin admin] 10.222.0.38 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.044835 Feb 17 04:28:41.880104 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: [pid: 83221|app: 0|req: 3/4] 10.222.0.38 () {62 vars in 1236 bytes} [Wed Feb 17 04:28:41 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:28:41.890440 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi [None req-39c0f3be-5c41-4f67-adda-be41c3114a46 admin admin] Calling method '>' {{(pid=83220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:28:41.908450 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: INFO nova.api.openstack.requestlog [None req-39c0f3be-5c41-4f67-adda-be41c3114a46 admin admin] 10.222.0.38 "GET /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.022051 Feb 17 04:28:41.909018 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: [pid: 83220|app: 0|req: 2/5] 10.222.0.38 () {58 vars in 1183 bytes} [Wed Feb 17 04:28:41 2021] GET /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:28:44.503480 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi [None req-df1d52c6-05b6-4d09-b2d1-3346880fbe6c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "ram": 512, "vcpus": 1, "disk": 5, "id": "d1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:28:44.526284 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:28:44.526284 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: warnings.warn(msg) Feb 17 04:28:44.548401 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: INFO nova.api.openstack.requestlog [None req-df1d52c6-05b6-4d09-b2d1-3346880fbe6c admin admin] 10.222.0.38 "POST /compute/v2.1/flavors" status: 200 len: 364 microversion: 2.1 time: 0.099913 Feb 17 04:28:44.549001 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: [pid: 83221|app: 0|req: 4/6] 10.222.0.38 () {62 vars in 1183 bytes} [Wed Feb 17 04:28:44 2021] POST /compute/v2.1/flavors => generated 364 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:28:44.560197 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi [None req-07c09e8a-4c08-4dcd-810c-3e12959b6e8d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:28:44.561772 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:28:44.561772 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: warnings.warn(msg) Feb 17 04:28:44.597670 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: INFO nova.api.openstack.requestlog [None req-07c09e8a-4c08-4dcd-810c-3e12959b6e8d admin admin] 10.222.0.38 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.041671 Feb 17 04:28:44.598279 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: [pid: 83220|app: 0|req: 3/7] 10.222.0.38 () {62 vars in 1236 bytes} [Wed Feb 17 04:28:44 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:28:44.608294 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi [None req-2f1f0855-dd93-4c47-9eb5-2ac7f806ed7f admin admin] Calling method '>' {{(pid=83221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:28:44.624139 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: INFO nova.api.openstack.requestlog [None req-2f1f0855-dd93-4c47-9eb5-2ac7f806ed7f admin admin] 10.222.0.38 "GET /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.019801 Feb 17 04:28:44.624698 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: [pid: 83221|app: 0|req: 5/8] 10.222.0.38 () {58 vars in 1183 bytes} [Wed Feb 17 04:28:44 2021] GET /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:28:47.177857 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi [None req-a09b5343-d4c3-47f7-995c-4da48ab1aa1b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "ram": 1024, "vcpus": 1, "disk": 10, "id": "d2", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:28:47.199921 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: INFO nova.api.openstack.requestlog [None req-a09b5343-d4c3-47f7-995c-4da48ab1aa1b admin admin] 10.222.0.38 "POST /compute/v2.1/flavors" status: 200 len: 364 microversion: 2.1 time: 0.076510 Feb 17 04:28:47.200513 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: [pid: 83220|app: 0|req: 4/9] 10.222.0.38 () {62 vars in 1183 bytes} [Wed Feb 17 04:28:47 2021] POST /compute/v2.1/flavors => generated 364 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:28:47.211774 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi [None req-b16989b9-387f-4478-a645-8aea61873f57 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:28:47.246136 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: INFO nova.api.openstack.requestlog [None req-b16989b9-387f-4478-a645-8aea61873f57 admin admin] 10.222.0.38 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.038136 Feb 17 04:28:47.246686 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: [pid: 83221|app: 0|req: 6/10] 10.222.0.38 () {62 vars in 1236 bytes} [Wed Feb 17 04:28:47 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:28:47.256857 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi [None req-a92a5240-aac9-4e20-88ea-850f819109a1 admin admin] Calling method '>' {{(pid=83220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:28:47.272627 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: INFO nova.api.openstack.requestlog [None req-a92a5240-aac9-4e20-88ea-850f819109a1 admin admin] 10.222.0.38 "GET /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.019541 Feb 17 04:28:47.273189 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: [pid: 83220|app: 0|req: 5/11] 10.222.0.38 () {58 vars in 1183 bytes} [Wed Feb 17 04:28:47 2021] GET /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:28:49.849390 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi [None req-509fbd21-fa04-41c7-808f-438d45a875fc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "ram": 2048, "vcpus": 2, "disk": 10, "id": "d3", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:28:49.872040 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: INFO nova.api.openstack.requestlog [None req-509fbd21-fa04-41c7-808f-438d45a875fc admin admin] 10.222.0.38 "POST /compute/v2.1/flavors" status: 200 len: 364 microversion: 2.1 time: 0.076790 Feb 17 04:28:49.872649 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: [pid: 83221|app: 0|req: 7/12] 10.222.0.38 () {62 vars in 1183 bytes} [Wed Feb 17 04:28:49 2021] POST /compute/v2.1/flavors => generated 364 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:28:49.885422 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi [None req-65f40b4a-19e5-4bb0-82e7-d5854620f549 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:28:49.921265 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: INFO nova.api.openstack.requestlog [None req-65f40b4a-19e5-4bb0-82e7-d5854620f549 admin admin] 10.222.0.38 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.039647 Feb 17 04:28:49.922361 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: [pid: 83220|app: 0|req: 6/13] 10.222.0.38 () {62 vars in 1236 bytes} [Wed Feb 17 04:28:49 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:28:49.932189 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi [None req-e7a5afe3-334a-43f4-a872-fb007194b1d8 admin admin] Calling method '>' {{(pid=83221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:28:49.949228 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: INFO nova.api.openstack.requestlog [None req-e7a5afe3-334a-43f4-a872-fb007194b1d8 admin admin] 10.222.0.38 "GET /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.020811 Feb 17 04:28:49.949940 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: [pid: 83221|app: 0|req: 8/14] 10.222.0.38 () {58 vars in 1183 bytes} [Wed Feb 17 04:28:49 2021] GET /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:28:52.505065 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi [None req-1c396796-5a41-4bcd-8304-7eae971ebcd4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "ram": 4096, "vcpus": 4, "disk": 20, "id": "d4", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:28:52.528990 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: INFO nova.api.openstack.requestlog [None req-1c396796-5a41-4bcd-8304-7eae971ebcd4 admin admin] 10.222.0.38 "POST /compute/v2.1/flavors" status: 200 len: 364 microversion: 2.1 time: 0.078340 Feb 17 04:28:52.529593 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: [pid: 83220|app: 0|req: 7/15] 10.222.0.38 () {62 vars in 1183 bytes} [Wed Feb 17 04:28:52 2021] POST /compute/v2.1/flavors => generated 364 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:28:52.541143 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi [None req-4c04d28a-7d0a-429e-aab3-c2b7a12d9792 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:28:52.576970 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: INFO nova.api.openstack.requestlog [None req-4c04d28a-7d0a-429e-aab3-c2b7a12d9792 admin admin] 10.222.0.38 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.039868 Feb 17 04:28:52.577512 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: [pid: 83221|app: 0|req: 9/16] 10.222.0.38 () {62 vars in 1236 bytes} [Wed Feb 17 04:28:52 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:28:52.588043 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi [None req-8287cb1c-7411-4bb2-9390-1a5b6869d5ad admin admin] Calling method '>' {{(pid=83220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:28:52.603524 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: INFO nova.api.openstack.requestlog [None req-8287cb1c-7411-4bb2-9390-1a5b6869d5ad admin admin] 10.222.0.38 "GET /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.019322 Feb 17 04:28:52.604076 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: [pid: 83220|app: 0|req: 8/17] 10.222.0.38 () {58 vars in 1183 bytes} [Wed Feb 17 04:28:52 2021] GET /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:28:55.165625 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi [None req-e8adb899-73e8-4d43-9a68-c98c0d8c0831 admin admin] Calling method '>' {{(pid=83221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:28:55.185545 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: INFO nova.api.openstack.requestlog [None req-e8adb899-73e8-4d43-9a68-c98c0d8c0831 admin admin] 10.222.0.38 "GET /compute/v2.1/flavors/detail" status: 200 len: 1786 microversion: 2.1 time: 0.073195 Feb 17 04:28:55.186130 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: [pid: 83221|app: 0|req: 10/18] 10.222.0.38 () {58 vars in 1150 bytes} [Wed Feb 17 04:28:55 2021] GET /compute/v2.1/flavors/detail => generated 1786 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:28:57.775328 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi [None req-734e3cc5-02c7-4d16-8c2f-67a405bc77a4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "ram": 512, "vcpus": 1, "disk": 1, "id": "1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:28:57.797269 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: INFO nova.api.openstack.requestlog [None req-734e3cc5-02c7-4d16-8c2f-67a405bc77a4 admin admin] 10.222.0.38 "POST /compute/v2.1/flavors" status: 200 len: 362 microversion: 2.1 time: 0.074512 Feb 17 04:28:57.797863 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: [pid: 83220|app: 0|req: 9/19] 10.222.0.38 () {62 vars in 1183 bytes} [Wed Feb 17 04:28:57 2021] POST /compute/v2.1/flavors => generated 362 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:28:57.809199 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi [None req-2411cbba-240f-4c2d-abbd-075937be02fa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:28:57.845002 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: INFO nova.api.openstack.requestlog [None req-2411cbba-240f-4c2d-abbd-075937be02fa admin admin] 10.222.0.38 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.039972 Feb 17 04:28:57.845526 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: [pid: 83221|app: 0|req: 11/20] 10.222.0.38 () {62 vars in 1233 bytes} [Wed Feb 17 04:28:57 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:28:57.855440 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi [None req-9db9ae7c-ac45-47a7-88e8-c1c7e7de59c8 admin admin] Calling method '>' {{(pid=83220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:28:57.870741 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: INFO nova.api.openstack.requestlog [None req-9db9ae7c-ac45-47a7-88e8-c1c7e7de59c8 admin admin] 10.222.0.38 "GET /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.019041 Feb 17 04:28:57.871305 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: [pid: 83220|app: 0|req: 10/21] 10.222.0.38 () {58 vars in 1180 bytes} [Wed Feb 17 04:28:57 2021] GET /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:29:00.442791 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi [None req-1f69fa59-66ab-48d3-9fb9-322a59883d58 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "ram": 2048, "vcpus": 1, "disk": 20, "id": "2", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:29:00.465475 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: INFO nova.api.openstack.requestlog [None req-1f69fa59-66ab-48d3-9fb9-322a59883d58 admin admin] 10.222.0.38 "POST /compute/v2.1/flavors" status: 200 len: 365 microversion: 2.1 time: 0.080523 Feb 17 04:29:00.466539 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: [pid: 83221|app: 0|req: 12/22] 10.222.0.38 () {62 vars in 1183 bytes} [Wed Feb 17 04:29:00 2021] POST /compute/v2.1/flavors => generated 365 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:29:00.477312 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi [None req-1266f97c-8824-493d-81c2-d81bdb0bb7ef admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:29:00.513645 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: INFO nova.api.openstack.requestlog [None req-1266f97c-8824-493d-81c2-d81bdb0bb7ef admin admin] 10.222.0.38 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.040114 Feb 17 04:29:00.514229 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: [pid: 83220|app: 0|req: 11/23] 10.222.0.38 () {62 vars in 1233 bytes} [Wed Feb 17 04:29:00 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:29:00.525081 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi [None req-f0a38fdc-cf66-43cd-ac79-226aa5d4ddb7 admin admin] Calling method '>' {{(pid=83221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:00.540305 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: INFO nova.api.openstack.requestlog [None req-f0a38fdc-cf66-43cd-ac79-226aa5d4ddb7 admin admin] 10.222.0.38 "GET /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.019071 Feb 17 04:29:00.540863 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: [pid: 83221|app: 0|req: 13/24] 10.222.0.38 () {58 vars in 1180 bytes} [Wed Feb 17 04:29:00 2021] GET /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:29:03.089969 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi [None req-debad897-ad73-408a-ab74-3c8b3fd5d747 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "ram": 4096, "vcpus": 2, "disk": 40, "id": "3", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:29:03.112016 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: INFO nova.api.openstack.requestlog [None req-debad897-ad73-408a-ab74-3c8b3fd5d747 admin admin] 10.222.0.38 "POST /compute/v2.1/flavors" status: 200 len: 366 microversion: 2.1 time: 0.076319 Feb 17 04:29:03.112608 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: [pid: 83220|app: 0|req: 12/25] 10.222.0.38 () {62 vars in 1183 bytes} [Wed Feb 17 04:29:03 2021] POST /compute/v2.1/flavors => generated 366 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:29:03.123200 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi [None req-22dfc665-d404-4eb9-9861-6325164554ca admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:29:03.160080 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: INFO nova.api.openstack.requestlog [None req-22dfc665-d404-4eb9-9861-6325164554ca admin admin] 10.222.0.38 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.040728 Feb 17 04:29:03.160679 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: [pid: 83221|app: 0|req: 14/26] 10.222.0.38 () {62 vars in 1233 bytes} [Wed Feb 17 04:29:03 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:29:03.170265 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi [None req-54ff64cd-9775-4ef6-87b7-2380db4cd7e4 admin admin] Calling method '>' {{(pid=83220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:03.186258 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: INFO nova.api.openstack.requestlog [None req-54ff64cd-9775-4ef6-87b7-2380db4cd7e4 admin admin] 10.222.0.38 "GET /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.019713 Feb 17 04:29:03.186866 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: [pid: 83220|app: 0|req: 13/27] 10.222.0.38 () {58 vars in 1180 bytes} [Wed Feb 17 04:29:03 2021] GET /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:29:05.763012 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi [None req-0caa6cab-63ef-4641-a69f-def46fb45197 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "ram": 8192, "vcpus": 4, "disk": 80, "id": "4", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:29:05.785230 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: INFO nova.api.openstack.requestlog [None req-0caa6cab-63ef-4641-a69f-def46fb45197 admin admin] 10.222.0.38 "POST /compute/v2.1/flavors" status: 200 len: 365 microversion: 2.1 time: 0.076533 Feb 17 04:29:05.785833 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: [pid: 83221|app: 0|req: 15/28] 10.222.0.38 () {62 vars in 1183 bytes} [Wed Feb 17 04:29:05 2021] POST /compute/v2.1/flavors => generated 365 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:29:05.797463 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi [None req-33fe504d-ff83-4b0e-a147-29a75695bf95 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:29:05.832398 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: INFO nova.api.openstack.requestlog [None req-33fe504d-ff83-4b0e-a147-29a75695bf95 admin admin] 10.222.0.38 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.039605 Feb 17 04:29:05.832940 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: [pid: 83220|app: 0|req: 14/29] 10.222.0.38 () {62 vars in 1233 bytes} [Wed Feb 17 04:29:05 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:29:05.842902 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi [None req-0801780d-c25f-4a6c-b844-049b68d3a194 admin admin] Calling method '>' {{(pid=83221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:05.859622 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: INFO nova.api.openstack.requestlog [None req-0801780d-c25f-4a6c-b844-049b68d3a194 admin admin] 10.222.0.38 "GET /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.019928 Feb 17 04:29:05.860563 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: [pid: 83221|app: 0|req: 16/30] 10.222.0.38 () {58 vars in 1180 bytes} [Wed Feb 17 04:29:05 2021] GET /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:29:08.434134 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi [None req-01e53bef-0562-4554-b506-3de1f514cb7a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "ram": 16384, "vcpus": 8, "disk": 160, "id": "5", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:29:08.457005 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: INFO nova.api.openstack.requestlog [None req-01e53bef-0562-4554-b506-3de1f514cb7a admin admin] 10.222.0.38 "POST /compute/v2.1/flavors" status: 200 len: 368 microversion: 2.1 time: 0.082564 Feb 17 04:29:08.457616 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: [pid: 83220|app: 0|req: 15/31] 10.222.0.38 () {62 vars in 1183 bytes} [Wed Feb 17 04:29:08 2021] POST /compute/v2.1/flavors => generated 368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:29:08.469577 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi [None req-90a10f77-2547-45f5-ac84-a2cb0b5d5dab admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:29:08.505338 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: INFO nova.api.openstack.requestlog [None req-90a10f77-2547-45f5-ac84-a2cb0b5d5dab admin admin] 10.222.0.38 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.040709 Feb 17 04:29:08.505904 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: [pid: 83221|app: 0|req: 17/32] 10.222.0.38 () {62 vars in 1233 bytes} [Wed Feb 17 04:29:08 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:29:08.516624 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi [None req-27cb2e58-628f-4665-9e5d-e9bdccda0e54 admin admin] Calling method '>' {{(pid=83220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:29:08.532461 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: INFO nova.api.openstack.requestlog [None req-27cb2e58-628f-4665-9e5d-e9bdccda0e54 admin admin] 10.222.0.38 "GET /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.020347 Feb 17 04:29:08.533026 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: [pid: 83220|app: 0|req: 16/33] 10.222.0.38 () {58 vars in 1180 bytes} [Wed Feb 17 04:29:08 2021] GET /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:30:19.662701 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi [None req-aa5caa86-6e63-425a-bcd5-72c8381701a4 admin admin] Calling method '>' {{(pid=83221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:19.687287 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: INFO nova.api.openstack.requestlog [None req-aa5caa86-6e63-425a-bcd5-72c8381701a4 admin admin] 10.222.0.38 "GET /compute/v2.1/flavors/detail" status: 200 len: 3562 microversion: 2.1 time: 0.077797 Feb 17 04:30:19.687880 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: [pid: 83221|app: 0|req: 18/34] 10.222.0.38 () {58 vars in 1150 bytes} [Wed Feb 17 04:30:19 2021] GET /compute/v2.1/flavors/detail => generated 3562 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:30:21.349762 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi [None req-27cb2e58-628f-4665-9e5d-e9bdccda0e54 admin admin] Calling method '>' {{(pid=83220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:21.350855 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: INFO nova.api.openstack.requestlog [None req-27cb2e58-628f-4665-9e5d-e9bdccda0e54 admin admin] 10.222.0.38 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001572 Feb 17 04:30:21.351330 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: [pid: 83220|app: 0|req: 17/35] 10.222.0.38 () {56 vars in 1065 bytes} [Wed Feb 17 04:30:21 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:30:21.532467 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi [None req-b9e75165-8dbe-4f76-9702-f1d8afcc9b92 admin admin] Calling method '>' {{(pid=83221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:21.547218 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: INFO nova.api.openstack.wsgi [None req-b9e75165-8dbe-4f76-9702-f1d8afcc9b92 admin admin] HTTP exception thrown: Flavor 42 could not be found. Feb 17 04:30:21.547848 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi [None req-b9e75165-8dbe-4f76-9702-f1d8afcc9b92 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=83221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:30:21.548691 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: INFO nova.api.openstack.requestlog [None req-b9e75165-8dbe-4f76-9702-f1d8afcc9b92 admin admin] 10.222.0.38 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.87 time: 0.069690 Feb 17 04:30:21.549240 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: [pid: 83221|app: 0|req: 19/36] 10.222.0.38 () {60 vars in 1181 bytes} [Wed Feb 17 04:30:21 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 17 04:30:21.559781 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi [None req-86a941cf-e29d-4703-a0d1-3ad13f84fdc0 admin admin] Calling method '>' {{(pid=83220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:21.581786 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: INFO nova.api.openstack.requestlog [None req-86a941cf-e29d-4703-a0d1-3ad13f84fdc0 admin admin] 10.222.0.38 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.026142 Feb 17 04:30:21.582349 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: [pid: 83220|app: 0|req: 18/37] 10.222.0.38 () {60 vars in 1201 bytes} [Wed Feb 17 04:30:21 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:30:21.593279 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi [None req-cb921035-a635-4ecb-85b9-342bfca340b0 admin admin] Calling method '>' {{(pid=83221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:21.616888 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: INFO nova.api.openstack.requestlog [None req-cb921035-a635-4ecb-85b9-342bfca340b0 admin admin] 10.222.0.38 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.028058 Feb 17 04:30:21.617452 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: [pid: 83221|app: 0|req: 20/38] 10.222.0.38 () {60 vars in 1201 bytes} [Wed Feb 17 04:30:21 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:30:21.627545 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi [None req-4e490eb8-f29e-454a-8b71-f15e798edf91 admin admin] Calling method '>' {{(pid=83220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:21.642123 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: INFO nova.api.openstack.wsgi [None req-4e490eb8-f29e-454a-8b71-f15e798edf91 admin admin] HTTP exception thrown: Flavor 42 could not be found. Feb 17 04:30:21.642765 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi [None req-4e490eb8-f29e-454a-8b71-f15e798edf91 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=83220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:30:21.643659 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: INFO nova.api.openstack.requestlog [None req-4e490eb8-f29e-454a-8b71-f15e798edf91 admin admin] 10.222.0.38 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.87 time: 0.019898 Feb 17 04:30:21.644174 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: [pid: 83220|app: 0|req: 19/39] 10.222.0.38 () {60 vars in 1181 bytes} [Wed Feb 17 04:30:21 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Feb 17 04:30:23.197400 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi [None req-cb921035-a635-4ecb-85b9-342bfca340b0 admin admin] Calling method '>' {{(pid=83221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:23.198464 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: INFO nova.api.openstack.requestlog [None req-cb921035-a635-4ecb-85b9-342bfca340b0 admin admin] 10.222.0.38 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001517 Feb 17 04:30:23.198976 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: [pid: 83221|app: 0|req: 21/40] 10.222.0.38 () {56 vars in 1065 bytes} [Wed Feb 17 04:30:23 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:30:23.379922 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi [None req-dbc870c8-b0cf-4b2a-a5b9-e8a41f66b257 admin admin] Calling method '>' {{(pid=83220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:23.395555 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: INFO nova.api.openstack.wsgi [None req-dbc870c8-b0cf-4b2a-a5b9-e8a41f66b257 admin admin] HTTP exception thrown: Flavor 84 could not be found. Feb 17 04:30:23.396176 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi [None req-dbc870c8-b0cf-4b2a-a5b9-e8a41f66b257 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=83220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:30:23.397025 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: INFO nova.api.openstack.requestlog [None req-dbc870c8-b0cf-4b2a-a5b9-e8a41f66b257 admin admin] 10.222.0.38 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.87 time: 0.069987 Feb 17 04:30:23.397571 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: [pid: 83220|app: 0|req: 20/41] 10.222.0.38 () {60 vars in 1181 bytes} [Wed Feb 17 04:30:23 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 17 04:30:23.408320 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi [None req-727f0dc6-2ac3-4dcf-92ab-bf159306b903 admin admin] Calling method '>' {{(pid=83221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:23.429913 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: INFO nova.api.openstack.requestlog [None req-727f0dc6-2ac3-4dcf-92ab-bf159306b903 admin admin] 10.222.0.38 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.025423 Feb 17 04:30:23.430474 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: [pid: 83221|app: 0|req: 22/42] 10.222.0.38 () {60 vars in 1201 bytes} [Wed Feb 17 04:30:23 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:30:23.441219 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi [None req-9777bfce-b021-481f-8d61-a5fb1d5f8bd4 admin admin] Calling method '>' {{(pid=83220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:23.463037 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: INFO nova.api.openstack.requestlog [None req-9777bfce-b021-481f-8d61-a5fb1d5f8bd4 admin admin] 10.222.0.38 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.025471 Feb 17 04:30:23.463601 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: [pid: 83220|app: 0|req: 21/43] 10.222.0.38 () {60 vars in 1201 bytes} [Wed Feb 17 04:30:23 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:30:23.473656 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi [None req-a5b2e3eb-1602-406e-b7dd-620062aee611 admin admin] Calling method '>' {{(pid=83221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:23.486762 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: INFO nova.api.openstack.wsgi [None req-a5b2e3eb-1602-406e-b7dd-620062aee611 admin admin] HTTP exception thrown: Flavor 84 could not be found. Feb 17 04:30:23.487379 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi [None req-a5b2e3eb-1602-406e-b7dd-620062aee611 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=83221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:30:23.488211 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: INFO nova.api.openstack.requestlog [None req-a5b2e3eb-1602-406e-b7dd-620062aee611 admin admin] 10.222.0.38 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.87 time: 0.018349 Feb 17 04:30:23.488750 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: [pid: 83221|app: 0|req: 23/44] 10.222.0.38 () {60 vars in 1181 bytes} [Wed Feb 17 04:30:23 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 17 04:30:25.046056 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi [None req-9777bfce-b021-481f-8d61-a5fb1d5f8bd4 admin admin] Calling method '>' {{(pid=83220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:25.047159 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: INFO nova.api.openstack.requestlog [None req-9777bfce-b021-481f-8d61-a5fb1d5f8bd4 admin admin] 10.222.0.38 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001544 Feb 17 04:30:25.047594 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: [pid: 83220|app: 0|req: 22/45] 10.222.0.38 () {56 vars in 1065 bytes} [Wed Feb 17 04:30:25 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:30:25.227040 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi [None req-b4a40f32-0e5e-46d2-bbd0-22ca83d78d1e admin admin] Calling method '>' {{(pid=83221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:25.240001 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: INFO nova.api.openstack.wsgi [None req-b4a40f32-0e5e-46d2-bbd0-22ca83d78d1e admin admin] HTTP exception thrown: Flavor 451 could not be found. Feb 17 04:30:25.240613 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi [None req-b4a40f32-0e5e-46d2-bbd0-22ca83d78d1e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=83221) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:30:25.241440 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: INFO nova.api.openstack.requestlog [None req-b4a40f32-0e5e-46d2-bbd0-22ca83d78d1e admin admin] 10.222.0.38 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.87 time: 0.068875 Feb 17 04:30:25.241982 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: [pid: 83221|app: 0|req: 24/46] 10.222.0.38 () {60 vars in 1184 bytes} [Wed Feb 17 04:30:25 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 17 04:30:25.252851 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi [None req-7a9d7634-6d6e-4d8b-b4d6-ffe767e42664 admin admin] Calling method '>' {{(pid=83220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:25.274640 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: INFO nova.api.openstack.requestlog [None req-7a9d7634-6d6e-4d8b-b4d6-ffe767e42664 admin admin] 10.222.0.38 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.025653 Feb 17 04:30:25.275209 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: [pid: 83220|app: 0|req: 23/47] 10.222.0.38 () {60 vars in 1201 bytes} [Wed Feb 17 04:30:25 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:30:25.285862 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi [None req-6c55e5f3-a8a9-43d1-919d-667a33ab93d5 admin admin] Calling method '>' {{(pid=83221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:25.307670 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: INFO nova.api.openstack.requestlog [None req-6c55e5f3-a8a9-43d1-919d-667a33ab93d5 admin admin] 10.222.0.38 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.025449 Feb 17 04:30:25.308226 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: [pid: 83221|app: 0|req: 25/48] 10.222.0.38 () {60 vars in 1201 bytes} [Wed Feb 17 04:30:25 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:30:25.318368 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi [None req-772ab950-97ae-4eb2-839b-b49265481620 admin admin] Calling method '>' {{(pid=83220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:25.331589 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: INFO nova.api.openstack.wsgi [None req-772ab950-97ae-4eb2-839b-b49265481620 admin admin] HTTP exception thrown: Flavor 451 could not be found. Feb 17 04:30:25.332210 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi [None req-772ab950-97ae-4eb2-839b-b49265481620 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=83220) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:30:25.333049 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: INFO nova.api.openstack.requestlog [None req-772ab950-97ae-4eb2-839b-b49265481620 admin admin] 10.222.0.38 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.87 time: 0.018487 Feb 17 04:30:25.333593 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: [pid: 83220|app: 0|req: 24/49] 10.222.0.38 () {60 vars in 1184 bytes} [Wed Feb 17 04:30:25 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 17 04:30:26.876052 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi [None req-6c55e5f3-a8a9-43d1-919d-667a33ab93d5 admin admin] Calling method '>' {{(pid=83221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:26.877125 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: INFO nova.api.openstack.requestlog [None req-6c55e5f3-a8a9-43d1-919d-667a33ab93d5 admin admin] 10.222.0.38 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001542 Feb 17 04:30:26.878342 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: [pid: 83221|app: 0|req: 26/50] 10.222.0.38 () {56 vars in 1065 bytes} [Wed Feb 17 04:30:26 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:30:27.060027 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi [None req-8518d99c-790e-4a2b-abc2-75bb684f8a5c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:30:27.083598 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: INFO nova.api.openstack.requestlog [None req-8518d99c-790e-4a2b-abc2-75bb684f8a5c admin admin] 10.222.0.38 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.87 time: 0.077205 Feb 17 04:30:27.084123 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: [pid: 83220|app: 0|req: 25/51] 10.222.0.38 () {64 vars in 1226 bytes} [Wed Feb 17 04:30:27 2021] POST /compute/v2.1/flavors => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:30:28.627225 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi [None req-6c55e5f3-a8a9-43d1-919d-667a33ab93d5 admin admin] Calling method '>' {{(pid=83221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:28.628284 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: INFO nova.api.openstack.requestlog [None req-6c55e5f3-a8a9-43d1-919d-667a33ab93d5 admin admin] 10.222.0.38 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001551 Feb 17 04:30:28.628716 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: [pid: 83221|app: 0|req: 27/52] 10.222.0.38 () {56 vars in 1065 bytes} [Wed Feb 17 04:30:28 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:30:28.809545 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi [None req-2b6967f0-447a-4aa0-883e-6704e253f35f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:30:28.833053 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: INFO nova.api.openstack.requestlog [None req-2b6967f0-447a-4aa0-883e-6704e253f35f admin admin] 10.222.0.38 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.87 time: 0.077667 Feb 17 04:30:28.833644 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: [pid: 83220|app: 0|req: 26/53] 10.222.0.38 () {64 vars in 1226 bytes} [Wed Feb 17 04:30:28 2021] POST /compute/v2.1/flavors => generated 405 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:30:30.398906 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi [None req-6c55e5f3-a8a9-43d1-919d-667a33ab93d5 admin admin] Calling method '>' {{(pid=83221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:30.400012 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: INFO nova.api.openstack.requestlog [None req-6c55e5f3-a8a9-43d1-919d-667a33ab93d5 admin admin] 10.222.0.38 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001535 Feb 17 04:30:30.400443 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: [pid: 83221|app: 0|req: 28/54] 10.222.0.38 () {56 vars in 1065 bytes} [Wed Feb 17 04:30:30 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:30:30.582815 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi [None req-35a5d54c-1704-408e-8a03-69b6606c4f78 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:30:30.606719 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: INFO nova.api.openstack.requestlog [None req-35a5d54c-1704-408e-8a03-69b6606c4f78 admin admin] 10.222.0.38 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.87 time: 0.077904 Feb 17 04:30:30.607243 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: [pid: 83220|app: 0|req: 27/55] 10.222.0.38 () {64 vars in 1226 bytes} [Wed Feb 17 04:30:30 2021] POST /compute/v2.1/flavors => generated 407 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:30:32.163077 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi [None req-6c55e5f3-a8a9-43d1-919d-667a33ab93d5 admin admin] Calling method '>' {{(pid=83221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:32.164139 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: INFO nova.api.openstack.requestlog [None req-6c55e5f3-a8a9-43d1-919d-667a33ab93d5 admin admin] 10.222.0.38 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001528 Feb 17 04:30:32.164575 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: [pid: 83221|app: 0|req: 29/56] 10.222.0.38 () {56 vars in 1065 bytes} [Wed Feb 17 04:30:32 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:30:32.348776 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi [None req-0b62f5ee-5594-4c63-8814-a7d68c883613 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:30:32.373547 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: INFO nova.api.openstack.requestlog [None req-0b62f5ee-5594-4c63-8814-a7d68c883613 admin admin] 10.222.0.38 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.87 time: 0.078943 Feb 17 04:30:32.374139 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: [pid: 83220|app: 0|req: 28/57] 10.222.0.38 () {64 vars in 1226 bytes} [Wed Feb 17 04:30:32 2021] POST /compute/v2.1/flavors => generated 409 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:30:33.937722 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi [None req-6c55e5f3-a8a9-43d1-919d-667a33ab93d5 admin admin] Calling method '>' {{(pid=83221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:33.938824 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: INFO nova.api.openstack.requestlog [None req-6c55e5f3-a8a9-43d1-919d-667a33ab93d5 admin admin] 10.222.0.38 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Feb 17 04:30:33.939263 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: [pid: 83221|app: 0|req: 30/58] 10.222.0.38 () {56 vars in 1065 bytes} [Wed Feb 17 04:30:33 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:30:34.119159 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi [None req-48e1db29-f562-4663-bb4c-2a2a86dac0c9 admin admin] Calling method '>' {{(pid=83220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:30:34.149386 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: INFO nova.api.openstack.requestlog [None req-48e1db29-f562-4663-bb4c-2a2a86dac0c9 admin admin] 10.222.0.38 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.87 time: 0.083933 Feb 17 04:30:34.149898 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: [pid: 83220|app: 0|req: 29/59] 10.222.0.38 () {60 vars in 1193 bytes} [Wed Feb 17 04:30:34 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:31:24.396833 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi [None req-6c55e5f3-a8a9-43d1-919d-667a33ab93d5 admin admin] Calling method '>' {{(pid=83221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:24.397895 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: INFO nova.api.openstack.requestlog [None req-6c55e5f3-a8a9-43d1-919d-667a33ab93d5 admin admin] 10.222.0.38 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Feb 17 04:31:24.398329 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: [pid: 83221|app: 0|req: 31/60] 10.222.0.38 () {56 vars in 1065 bytes} [Wed Feb 17 04:31:24 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:31:24.582257 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi [None req-2e61126b-0265-45cb-b594-54175a41c390 admin admin] Calling method '>' {{(pid=83220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:31:24.610890 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: INFO nova.api.openstack.requestlog [None req-2e61126b-0265-45cb-b594-54175a41c390 admin admin] 10.222.0.38 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.87 time: 0.083471 Feb 17 04:31:24.611410 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: [pid: 83220|app: 0|req: 30/61] 10.222.0.38 () {60 vars in 1193 bytes} [Wed Feb 17 04:31:24 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:32:42.756300 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi [None req-8326a72c-1a5c-4016-8bab-aec5188ada20 tempest-verify_tempest_config-2069902791 tempest-verify_tempest_config-2069902791-project] Calling method '>' {{(pid=83221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:32:42.759303 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: INFO nova.api.openstack.requestlog [None req-8326a72c-1a5c-4016-8bab-aec5188ada20 tempest-verify_tempest_config-2069902791 tempest-verify_tempest_config-2069902791-project] 10.222.0.38 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.119876 Feb 17 04:32:42.759926 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: [pid: 83221|app: 0|req: 32/62] 10.222.0.38 () {58 vars in 1124 bytes} [Wed Feb 17 04:32:42 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:34:15.059832 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi [None req-2e61126b-0265-45cb-b594-54175a41c390 admin admin] Calling method '>' {{(pid=83220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:15.060941 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: INFO nova.api.openstack.requestlog [None req-2e61126b-0265-45cb-b594-54175a41c390 admin admin] 10.222.0.38 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001864 Feb 17 04:34:15.061441 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: [pid: 83220|app: 0|req: 31/63] 10.222.0.38 () {56 vars in 1065 bytes} [Wed Feb 17 04:34:15 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:34:15.324931 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi [None req-da06a0cb-14cf-4bcf-a94f-daa78ef4ddd7 admin admin] Calling method '>' {{(pid=83221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:15.326226 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:34:15.326226 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: warnings.warn(msg) Feb 17 04:34:15.327884 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG oslo_concurrency.lockutils [None req-da06a0cb-14cf-4bcf-a94f-daa78ef4ddd7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:15.328373 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG oslo_concurrency.lockutils [None req-da06a0cb-14cf-4bcf-a94f-daa78ef4ddd7 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=83221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:15.329221 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG oslo_concurrency.lockutils [None req-da06a0cb-14cf-4bcf-a94f-daa78ef4ddd7 admin admin] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:15.329699 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG oslo_concurrency.lockutils [None req-da06a0cb-14cf-4bcf-a94f-daa78ef4ddd7 admin admin] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=83221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:15.363086 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: INFO nova.api.openstack.requestlog [None req-da06a0cb-14cf-4bcf-a94f-daa78ef4ddd7 admin admin] 10.222.0.38 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.87 time: 0.168690 Feb 17 04:34:15.363670 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: [pid: 83221|app: 0|req: 33/64] 10.222.0.38 () {60 vars in 1184 bytes} [Wed Feb 17 04:34:15 2021] GET /compute/v2.1/os-services => generated 791 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:34:17.040067 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi [None req-2e61126b-0265-45cb-b594-54175a41c390 admin admin] Calling method '>' {{(pid=83220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:17.041842 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: INFO nova.api.openstack.requestlog [None req-2e61126b-0265-45cb-b594-54175a41c390 admin admin] 10.222.0.38 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002208 Feb 17 04:34:17.042270 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: [pid: 83220|app: 0|req: 32/65] 10.222.0.38 () {56 vars in 1065 bytes} [Wed Feb 17 04:34:17 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:34:17.227288 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi [None req-d7fab318-4e8c-4bbc-82c2-987e4eee1e5b admin admin] Calling method '>' {{(pid=83221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:17.229362 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:34:17.229362 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: warnings.warn(msg) Feb 17 04:34:17.231137 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG oslo_concurrency.lockutils [None req-d7fab318-4e8c-4bbc-82c2-987e4eee1e5b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:17.231634 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG oslo_concurrency.lockutils [None req-d7fab318-4e8c-4bbc-82c2-987e4eee1e5b admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=83221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:17.232481 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG oslo_concurrency.lockutils [None req-d7fab318-4e8c-4bbc-82c2-987e4eee1e5b admin admin] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:17.232968 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG oslo_concurrency.lockutils [None req-d7fab318-4e8c-4bbc-82c2-987e4eee1e5b admin admin] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=83221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:17.264806 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: INFO nova.api.openstack.requestlog [None req-d7fab318-4e8c-4bbc-82c2-987e4eee1e5b admin admin] 10.222.0.38 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.87 time: 0.092959 Feb 17 04:34:17.265417 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: [pid: 83221|app: 0|req: 34/66] 10.222.0.38 () {60 vars in 1184 bytes} [Wed Feb 17 04:34:17 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:34:29.249401 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi [None req-2e61126b-0265-45cb-b594-54175a41c390 admin admin] Calling method '>' {{(pid=83220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:29.250500 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: INFO nova.api.openstack.requestlog [None req-2e61126b-0265-45cb-b594-54175a41c390 admin admin] 10.222.0.38 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001554 Feb 17 04:34:29.250990 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: [pid: 83220|app: 0|req: 33/67] 10.222.0.38 () {56 vars in 1065 bytes} [Wed Feb 17 04:34:29 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:34:29.431659 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi [None req-12a2aaae-92a3-4c0a-b115-c411558ead15 admin admin] Calling method '>' {{(pid=83221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:29.432920 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:34:29.432920 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: warnings.warn(msg) Feb 17 04:34:29.434799 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG oslo_concurrency.lockutils [None req-12a2aaae-92a3-4c0a-b115-c411558ead15 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:29.435290 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG oslo_concurrency.lockutils [None req-12a2aaae-92a3-4c0a-b115-c411558ead15 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=83221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:29.436128 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG oslo_concurrency.lockutils [None req-12a2aaae-92a3-4c0a-b115-c411558ead15 admin admin] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:29.436599 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG oslo_concurrency.lockutils [None req-12a2aaae-92a3-4c0a-b115-c411558ead15 admin admin] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=83221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:29.464271 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: INFO nova.api.openstack.requestlog [None req-12a2aaae-92a3-4c0a-b115-c411558ead15 admin admin] 10.222.0.38 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.87 time: 0.086477 Feb 17 04:34:29.464850 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: [pid: 83221|app: 0|req: 35/68] 10.222.0.38 () {60 vars in 1184 bytes} [Wed Feb 17 04:34:29 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:34:31.080395 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi [None req-2e61126b-0265-45cb-b594-54175a41c390 admin admin] Calling method '>' {{(pid=83220) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:31.081460 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: INFO nova.api.openstack.requestlog [None req-2e61126b-0265-45cb-b594-54175a41c390 admin admin] 10.222.0.38 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 Feb 17 04:34:31.081901 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: [pid: 83220|app: 0|req: 34/69] 10.222.0.38 () {56 vars in 1065 bytes} [Wed Feb 17 04:34:31 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:34:31.267619 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG nova.api.openstack.wsgi [None req-5515f063-0caa-416e-b750-e9f6b71c20fd admin admin] Calling method '>' {{(pid=83221) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:34:31.268875 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:34:31.268875 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: warnings.warn(msg) Feb 17 04:34:31.270450 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG oslo_concurrency.lockutils [None req-5515f063-0caa-416e-b750-e9f6b71c20fd admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:31.270967 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG oslo_concurrency.lockutils [None req-5515f063-0caa-416e-b750-e9f6b71c20fd admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=83221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:31.271815 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG oslo_concurrency.lockutils [None req-5515f063-0caa-416e-b750-e9f6b71c20fd admin admin] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:34:31.272288 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: DEBUG oslo_concurrency.lockutils [None req-5515f063-0caa-416e-b750-e9f6b71c20fd admin admin] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=83221) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:34:31.299986 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: INFO nova.api.openstack.requestlog [None req-5515f063-0caa-416e-b750-e9f6b71c20fd admin admin] 10.222.0.38 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.87 time: 0.088379 Feb 17 04:34:31.300577 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: [pid: 83221|app: 0|req: 36/70] 10.222.0.38 () {60 vars in 1184 bytes} [Wed Feb 17 04:34:31 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:35:28.012139 dv-cinder-760197-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Feb 17 04:35:28.012591 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: Wed Feb 17 04:35:28 2021 - graceful shutdown triggered... Feb 17 04:35:28.013011 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: Gracefully killing worker 1 (pid: 83220)... Feb 17 04:35:28.013103 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: Gracefully killing worker 2 (pid: 83221)... Feb 17 04:35:29.012780 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: worker 1 buried after 1 seconds Feb 17 04:35:29.012780 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: worker 2 buried after 1 seconds Feb 17 04:35:29.012780 dv-cinder-760197-3-iscsi devstack@n-api.service[83219]: goodbye to uWSGI. Feb 17 04:35:29.014438 dv-cinder-760197-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Feb 17 04:35:29.016128 dv-cinder-760197-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Feb 17 04:35:29.025036 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Feb 17 04:35:29.027083 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: *** Starting uWSGI 2.0.15-debian (64bit) on [Wed Feb 17 04:35:29 2021] *** Feb 17 04:35:29.027083 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: compiled with version: 7.3.0 on 28 September 2018 15:41:15 Feb 17 04:35:29.027083 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: os: Linux-4.15.0-55-generic #60-Ubuntu SMP Tue Jul 2 18:22:20 UTC 2019 Feb 17 04:35:29.027083 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: nodename: dv-cinder-760197-3-iscsi Feb 17 04:35:29.027083 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: machine: x86_64 Feb 17 04:35:29.027083 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: clock source: unix Feb 17 04:35:29.027083 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: pcre jit disabled Feb 17 04:35:29.027083 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: detected number of CPU cores: 4 Feb 17 04:35:29.027083 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: current working directory: / Feb 17 04:35:29.027083 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: detected binary path: /usr/bin/uwsgi-core Feb 17 04:35:29.027083 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: dropping root privileges as early as possible Feb 17 04:35:29.027083 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: your processes number limit is 47843 Feb 17 04:35:29.027083 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: your memory page size is 4096 bytes Feb 17 04:35:29.027083 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: detected max file descriptor number: 2048 Feb 17 04:35:29.028340 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: lock engine: pthread robust mutexes Feb 17 04:35:29.028340 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: thunder lock: enabled Feb 17 04:35:29.028340 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Feb 17 04:35:29.028340 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: dropping root privileges after socket binding Feb 17 04:35:29.028340 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: Python version: 3.6.9 (default, Oct 8 2020, 12:12:24) [GCC 8.4.0] Feb 17 04:35:29.075584 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: Python main interpreter initialized at 0x55de86f439c0 Feb 17 04:35:29.075584 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: dropping root privileges after plugin initialization Feb 17 04:35:29.075584 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: python threads support enabled Feb 17 04:35:29.075584 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: your server socket listen backlog is limited to 100 connections Feb 17 04:35:29.075584 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: your mercy for graceful operations on workers is 90 seconds Feb 17 04:35:29.076152 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: mapped 402621 bytes (393 KB) for 2 cores Feb 17 04:35:29.076152 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: *** Operational MODE: preforking *** Feb 17 04:35:29.076338 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: dropping root privileges after application loading Feb 17 04:35:29.076338 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: *** uWSGI is running in multiple interpreter mode *** Feb 17 04:35:29.076338 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: spawned uWSGI master process (pid: 98078) Feb 17 04:35:29.076426 dv-cinder-760197-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Feb 17 04:35:29.076737 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: spawned uWSGI worker 1 (pid: 98080, cores: 1) Feb 17 04:35:29.077045 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: spawned uWSGI worker 2 (pid: 98081, cores: 1) Feb 17 04:35:29.077151 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Feb 17 04:35:33.703244 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Feb 17 04:35:33.703757 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Feb 17 04:35:33.705402 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Feb 17 04:35:33.705841 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Feb 17 04:35:33.706134 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Feb 17 04:35:33.706611 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.706986 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.707352 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.707712 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.708090 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.708444 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.708808 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.709178 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.709547 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.709844 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.710213 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.710594 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-760197-3-iscsi {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.710968 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.711324 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.712232 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.712569 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.712909 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.713277 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.713628 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.714247 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.714616 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.714959 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.715312 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.715699 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.716055 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.716406 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.716775 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.717128 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.717500 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.717852 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.718220 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-760197-3-iscsi {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.718606 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.718954 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.719309 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.719797 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.720148 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.720508 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.720863 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.721235 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.721585 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.721960 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.722327 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.722723 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.723091 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.723436 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.723783 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.724137 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.724500 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.724844 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.725187 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.725478 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.725821 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.726190 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.726556 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.726957 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.727871 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.728159 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Feb 17 04:35:33.728265 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.728522 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Feb 17 04:35:33.728620 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.728895 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.729241 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.729588 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.729937 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.730104 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Feb 17 04:35:33.730253 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.730524 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Feb 17 04:35:33.730724 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.730905 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Feb 17 04:35:33.731058 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.731275 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.731440 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.731599 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.731750 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.731958 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.732115 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.732328 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.732482 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.732686 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.732843 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.733034 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.733201 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.733399 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.733551 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.733926 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.734091 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.38 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.734091 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.38 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.734383 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.734383 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.734727 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.734871 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.735012 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.735153 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-760197-3-iscsi {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.735316 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.735465 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.735605 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.736010 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.736170 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.736170 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.736453 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.736453 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.736742 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.736882 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.737036 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.737179 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.737332 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.737491 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.737639 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.737786 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.738074 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.738246 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.738397 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.738539 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.738754 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.738921 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.739076 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.739253 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.739405 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.739559 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.739701 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.739847 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.740013 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.740416 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.740616 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.740760 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.740902 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.741049 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.741196 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.741366 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.741579 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.741733 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.741893 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.741893 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.742254 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-760197-3-iscsi {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.742411 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.742587 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.742749 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.742899 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.743046 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.743195 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.743342 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.743482 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.743629 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.743780 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.743920 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.744072 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.744212 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.744443 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.744594 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.744806 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.744961 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.745150 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.745299 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.745494 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.745643 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.746178 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.746348 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.746504 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.746697 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.746843 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.746998 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.747140 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.747291 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.747432 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.747579 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.747720 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.747862 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.748002 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.748153 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.748311 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.748452 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.748598 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.748746 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.748898 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.749099 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.749255 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.749439 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.749587 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.749785 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.749943 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.750150 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.750630 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.750630 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.750940 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.751090 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.751823 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.751982 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.752136 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.752136 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.752627 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.752778 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.752931 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.753073 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.753226 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.753376 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.753517 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.753658 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.753798 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.753944 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.754366 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.754519 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.754711 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.754856 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.755003 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.755162 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.755315 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.755456 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.756567 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.756744 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.756889 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.757040 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.757204 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.757354 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.757501 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.757643 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.757784 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.757997 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.758157 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.38 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.758387 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.758555 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.38 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.758753 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.758897 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.759049 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.759201 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.759343 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.759484 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.759625 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.759765 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.759915 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.760055 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.760206 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.760370 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.760370 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.760908 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.761064 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.761432 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.761584 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.761727 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.761970 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.762131 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.762274 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.762422 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.762769 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.762929 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.763079 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.763230 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.763371 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.763512 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.763660 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.763807 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.763954 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.764105 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.764258 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.764406 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.764553 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.764704 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.764851 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.765005 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.765153 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.765301 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.765442 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.765582 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.765731 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.765878 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.766026 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.766171 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.766318 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.766318 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.767051 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.767210 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.767352 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.767493 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.767639 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.767781 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.767930 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.768044 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.768250 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.768643 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.768810 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.768810 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.769218 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.769420 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.769524 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.769627 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.769726 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.769830 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.769936 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.770035 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.770138 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.770236 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.770334 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.770443 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.770547 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.770903 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.771024 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.771125 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.771229 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.771339 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.771458 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.771564 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.771673 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.771771 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.771873 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.772162 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.772275 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.772374 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.772471 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.772573 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.772672 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.772797 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.772903 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.773007 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.773104 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.773202 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.773320 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.773426 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.773525 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.773623 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.773720 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.773825 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.774468 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.774592 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.774693 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.774803 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.775024 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.775286 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.775396 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.775637 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.775739 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.776007 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.776115 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.776345 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.776453 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.776687 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.776838 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.777047 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.777189 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.777400 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.777523 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.777745 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.777856 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.778090 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.778194 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.778452 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.778605 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 04:35:33.778834 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.778947 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.779188 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.779304 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.779570 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.779680 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.779933 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.780036 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.780275 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.780386 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.780648 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.780771 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.781016 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.781133 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.781368 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.781486 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.781709 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.781814 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.782063 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.782160 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.782410 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.782524 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.782783 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.782889 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.783127 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.783230 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.783478 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.783583 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.783822 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.783932 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.784167 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.784277 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.784512 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.784618 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.784856 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.784964 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.785202 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.785322 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.785558 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.785663 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.785929 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.786187 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.786295 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.786537 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.786676 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.786911 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.787044 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.787256 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.787401 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.787651 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.787756 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.787997 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.788100 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.788387 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.788515 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.788744 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.788929 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.789113 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.789236 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.789496 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.790162 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.790422 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.790716 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.790849 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.790963 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.791180 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.791306 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.791497 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.791627 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.791863 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.791985 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.792269 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.792423 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.792599 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.792722 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.792947 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.793078 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.793296 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.793433 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.793798 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.794180 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.794534 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.794730 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.794917 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.795287 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.795591 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.795720 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.796049 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.796168 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.796269 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.796609 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.796723 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.796955 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.797310 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.797426 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.797664 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.797781 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.798019 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.798127 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.798373 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.798483 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.798746 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.798852 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.799105 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.799215 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.799454 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.799564 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.799801 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.799914 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.800147 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.800250 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.800501 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.800612 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.800852 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.800962 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.801202 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.801327 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.801571 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.801678 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.801917 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.802020 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.802262 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.802368 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.802621 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.802723 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.802979 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.803086 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.803332 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.803432 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.803678 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.803852 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.804108 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.804290 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.804430 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.804647 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.804757 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.805031 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.805163 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.805416 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.805527 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.805757 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.805872 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.806115 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.806216 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.806468 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.806591 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.806853 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.806953 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.807208 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.807372 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.807535 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.807745 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.807917 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.808116 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.808215 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.808471 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.808577 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.809083 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.809182 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.809436 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.809536 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.809789 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.809888 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.810133 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.810240 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.810491 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.810621 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.810865 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.810981 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.811209 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.811324 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.811554 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.811661 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.811896 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.811995 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.812239 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.812345 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.812599 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.812699 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.812948 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.813287 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.813387 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.813666 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.813767 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.814026 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.814126 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.814388 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.814619 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.814801 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.814957 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.815120 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.815335 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.815443 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.815697 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.815805 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.816072 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.816178 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.816439 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.816539 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.816781 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.816890 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.817128 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.817228 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.817473 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.817573 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.817825 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.817990 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.818148 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.818308 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.818458 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.818649 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.818822 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.818974 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.819132 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.819289 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.819445 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.819595 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.819808 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.819974 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.820124 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.820274 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.820423 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.820578 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.821277 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.821528 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.821712 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.821864 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.822015 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.822173 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.822337 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.822488 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.822750 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.822911 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.823108 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.823280 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.823433 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.823590 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.823741 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.823897 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.824055 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.824216 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.824451 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.824627 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.824984 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.825153 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.825341 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.825510 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.825677 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.825829 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.826084 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.826250 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.826401 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.826582 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.826741 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.826892 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.827119 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.827287 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.827449 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.827607 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.827758 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.827922 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.828111 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.828270 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.828465 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.828625 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.828785 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.828934 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.829134 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.829299 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.829472 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.829624 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.829824 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.829989 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.830140 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.830297 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.830497 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.830691 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.830850 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.831008 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.831207 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.831585 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.831758 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.831918 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.832152 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.832318 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.832509 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.832680 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.832879 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.833038 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.833194 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.833344 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.833554 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.833725 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.833877 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.834027 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.834191 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.834342 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.834545 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.834753 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.834914 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.835066 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.835215 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.835389 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.835546 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.835704 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.835894 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.836054 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.836255 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.837000 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.837249 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.837418 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.837616 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.837775 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.837976 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.838142 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.838301 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.838452 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.838668 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.838904 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.839070 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.839266 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.839441 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.839592 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.839742 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.839939 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.840098 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.840255 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.840416 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.840573 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.840943 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.841109 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.841268 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.841425 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.841585 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.841751 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.841972 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.842131 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.842282 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.842440 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.842656 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.842818 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.842979 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.843135 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.843396 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.843563 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.843720 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.843888 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.844039 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.844196 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.844398 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.844564 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.844722 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.844873 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.845030 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.845181 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.845397 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.845565 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.845723 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.845874 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.846032 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.846187 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.846384 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.846555 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.846734 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.846895 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.847056 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.847213 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.847414 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.847637 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.847788 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.847939 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.848088 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.848248 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.848410 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.848563 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.848717 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.848873 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.849023 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.849180 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.849338 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.849496 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.849710 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.849869 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.850066 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.850224 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.850391 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.850542 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.850747 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.850908 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.851059 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.851214 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.851453 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.851612 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.851763 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.851911 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.852189 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.852360 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.852556 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.852726 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.852877 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.853079 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.853302 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.853521 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.853679 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.853830 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.853986 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.854136 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.854286 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.854443 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.854653 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.854834 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.854993 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.855144 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.855294 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.855452 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.855602 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.855751 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.855907 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.856065 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.856228 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.856385 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.856630 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.856789 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.856986 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.857149 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.857310 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.857461 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.857655 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.857814 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.858008 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.858175 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.858337 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.858488 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.858666 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.858885 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.859047 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.859207 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.859369 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.859526 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.859675 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.859824 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.859980 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.860140 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.860329 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.860494 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.860652 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.860808 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.861005 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.861172 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.861407 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.861572 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.861723 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.861879 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.862076 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.862248 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.862400 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.862555 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.862734 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.862884 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.863081 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.863250 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.863452 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.863619 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.863769 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.863917 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.864120 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.864289 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.864508 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.864660 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.864810 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.864958 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.865116 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.865273 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.865423 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.865678 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.865846 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.866034 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.866200 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.866389 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.866554 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.866794 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.866945 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.867094 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.867250 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.867452 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.867651 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.867809 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.868135 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.868303 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.868463 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.868613 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.868812 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.868979 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.869213 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.869379 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.869531 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.869687 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.869911 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.870076 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.870234 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.870401 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.870640 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.870804 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.871010 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.871178 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.871329 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.871486 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.871698 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.871856 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.872135 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.872294 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.872496 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.872667 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.872832 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.872990 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.873178 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.873343 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.873500 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.873662 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.873855 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.874186 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.874344 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.874494 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.874697 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.874859 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.875010 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.875175 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.875333 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.875482 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.875643 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.875805 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.875956 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.876105 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.876255 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.876404 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.876566 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.876724 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.876924 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.877086 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.877245 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.877403 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.877565 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.877716 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.877867 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.878022 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.878174 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.878324 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.878482 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.878735 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.878896 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.879048 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.879205 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.879373 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.879531 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.879689 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.879839 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.880074 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.880239 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.880398 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.880554 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.880743 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.880901 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.881089 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.881254 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.881417 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.881582 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.881797 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.881956 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.882114 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.882270 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.882470 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.882681 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.882844 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.883001 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.883159 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.883857 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.884269 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.884393 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.884631 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.884742 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.884993 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.885122 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.885343 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.885456 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.885699 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.885802 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.886056 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.886251 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.886397 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.886609 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.886792 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.886945 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.887093 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.887255 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.887450 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.887608 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.887764 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.887914 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.888111 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.888270 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.888464 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.888622 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.888779 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.888948 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.889107 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.889264 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.889416 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.889572 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.889773 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.889937 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.890101 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.890258 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.890419 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.890636 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.890803 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.890955 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.891121 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.891271 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.891430 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.891581 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.891736 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.891891 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.892110 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.892276 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.892433 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.892690 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.892848 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.893134 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.893517 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.893679 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.893830 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.893987 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.894144 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.894303 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.894517 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.894788 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.894955 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.895113 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.895265 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.895428 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.895582 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.895907 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.896105 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.896460 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.896627 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.896790 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.896942 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.897098 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.897256 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.897415 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.897574 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.897725 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.897882 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.898033 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.898198 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.898349 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.898506 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.898828 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.899543 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.899738 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.899978 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.900136 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.900305 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.driver = filter_scheduler {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.900463 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.900614 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.900770 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.900928 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.901151 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.901326 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.901484 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.901634 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.901837 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.902006 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.902196 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.periodic_task_interval = 60 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.902354 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.902548 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.902754 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.902914 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.903073 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.903229 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.903393 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.903592 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.903758 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.903917 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.904070 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.904227 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.904377 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.904597 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.904756 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.904919 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.905076 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.905278 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.905452 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.905604 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.905766 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.905960 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.906125 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.906276 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.906443 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.906709 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.906933 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.907086 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.907243 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.907394 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.907565 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.907723 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.907883 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.908039 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.908196 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.908354 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.908505 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.908666 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.908817 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.909009 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.909168 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.909375 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.909534 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.909766 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.909929 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.910089 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.910240 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.910397 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.910558 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.910818 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.910981 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.911132 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.911283 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.911449 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.911614 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.911775 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.911927 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.912076 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.912226 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.912433 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.912602 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.912753 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.912910 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.913137 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.913355 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.913629 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.913797 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.913996 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.914164 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.914363 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.914558 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.914818 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.914987 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.915146 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.915298 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.915448 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.915598 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.915757 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.915914 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.916065 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.916213 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.916379 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.916531 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.916709 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.916866 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.917015 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.917165 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.917321 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.917470 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.917672 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.917840 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.917991 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.918141 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.918341 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.918508 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.918713 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.918874 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.919025 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.919176 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.919384 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.919634 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.919802 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.920035 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.920205 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.920358 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.920517 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.920735 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.920961 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.921114 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.921264 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.921421 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.921579 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.921742 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.921909 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.922068 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.922224 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.922384 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.922535 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.922786 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.922956 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.923108 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.923269 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.923420 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.923576 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.923738 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.924029 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.924189 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.924382 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.924548 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.924712 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.924864 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.925020 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.925191 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.925347 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.925503 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.925664 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.925821 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.926026 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.926193 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.926344 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.926592 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.926762 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.926924 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.927075 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.927233 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.927393 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.927671 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.927838 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.927996 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.928147 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.928334 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.928493 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.driver = filter_scheduler {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.928651 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.928814 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.928970 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.929120 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.929317 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.929483 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.929651 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.929808 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.929958 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.930139 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.930400 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.930578 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.periodic_task_interval = 60 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.930752 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.930947 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.931106 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.931306 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.931466 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.931654 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.931830 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.932032 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.932199 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.932373 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.932526 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.932677 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.932839 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.932991 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.933140 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.933346 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.933506 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.933715 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.934132 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.934300 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.934452 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.934682 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.934842 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.935044 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.935204 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.935402 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.935570 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.935822 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.935990 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.936188 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.936359 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.936557 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.936717 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.936920 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.937087 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.937287 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.937452 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.937611 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.937762 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.937983 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.938150 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.938347 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.938516 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.938722 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.938889 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.939040 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.939260 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.939412 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.939562 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.939711 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.939869 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.940027 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.940178 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.940380 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.940545 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.940702 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.940869 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.941028 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.941185 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.941346 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.941547 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.941714 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.942030 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.942201 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.942419 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.942601 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.942811 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.942985 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.943148 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.943321 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.943473 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.943630 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.943831 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.943992 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.944154 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.944314 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.944506 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.944673 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.944826 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.944984 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.945183 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.945361 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.945513 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.945664 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.954642 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.954862 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.955059 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.955229 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.955388 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.955544 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.955704 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.955865 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.956025 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.956191 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.956362 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.956517 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.956675 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.956840 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.956840 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.957129 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.957281 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.957438 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.957593 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.957751 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.957904 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.958061 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.958219 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.958382 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.958555 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.958749 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.958908 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.959066 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.959228 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.959387 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.959550 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.959708 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.959866 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.960018 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.960169 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.960330 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.960494 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.960646 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.960804 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.960956 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.961106 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.961264 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.962078 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.962265 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.962426 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.962782 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.962941 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.963093 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.963274 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.963436 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.963588 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.963739 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.963898 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.964062 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.964220 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.964372 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.964522 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.964681 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.964840 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.965004 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.965157 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.965317 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.965474 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.965626 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.965784 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.965950 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.966108 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.966266 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.966425 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.966658 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.966826 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.966985 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.967138 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.967289 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.967450 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.967613 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.967772 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.967930 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.968083 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.968240 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.968400 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.968550 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.968706 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.968864 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.969016 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.969168 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.969326 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.969492 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.969644 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.969805 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.969962 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.970114 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.970273 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.970431 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.970431 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.970789 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.970789 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.971078 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.971242 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.971394 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.971394 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.971689 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.971846 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.972006 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.972158 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.972309 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.972309 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.972596 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.972747 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.972971 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.973138 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.973294 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.973462 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.973614 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.973764 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.973923 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.974074 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.974225 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.974376 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.974526 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.974700 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.974866 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.975019 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.975176 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.975328 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.975491 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.975654 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.975806 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.975957 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.976114 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.976265 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.976423 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.976586 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.976738 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.976894 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.977098 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.977388 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.977560 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.977723 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.977881 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.978033 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.978183 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.978334 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.978501 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.978687 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.978849 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.979002 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.979152 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.979309 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.979469 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.979630 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.979788 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.979946 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.979946 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=98080) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Feb 17 04:35:33.980236 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.980236 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.980236 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.980236 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.980236 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.980236 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.980236 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.980236 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.981472 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.981472 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.981472 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.981472 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.981472 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.981472 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.981472 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.981472 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.982632 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.982632 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.982632 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.982632 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.982632 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.982632 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.982632 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.982632 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.983801 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.983801 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.983801 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.983801 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.983801 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.983801 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.983801 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.984806 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.984806 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.984806 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.985257 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.985422 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.985732 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.986086 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.986457 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.986836 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.987200 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.987561 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.987925 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.988311 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.988677 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.989051 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.989410 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.989784 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.990142 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.990514 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.991002 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.991370 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.991779 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.992511 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.992511 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.993111 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.993750 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.994285 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.994676 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.995046 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.995436 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.995819 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.996175 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.996554 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.997090 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.997460 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.997958 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.998473 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.998887 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.999250 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.999620 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:33.999980 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:34.000381 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:34.000750 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:34.001116 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:34.001494 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:34.001875 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:34.002253 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:34.002654 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:34.003063 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:34.003428 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:34.003826 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:34.004210 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 04:35:34.004492 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=98081) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Feb 17 04:35:34.010102 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_db.sqlalchemy.engines [None req-cdab5c42-fa7f-4c31-b568-863668539a7d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=98080) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 17 04:35:34.041331 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_db.sqlalchemy.engines [None req-82967fe4-7212-442a-9102-b4ce91ba439e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=98081) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 17 04:35:34.279651 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.context [None req-cdab5c42-fa7f-4c31-b568-863668539a7d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cae8762b-f9db-4634-9f99-cd5d65b514f3(cell1) {{(pid=98080) load_cells /opt/stack/nova/nova/context.py:466}} Feb 17 04:35:34.285126 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-cdab5c42-fa7f-4c31-b568-863668539a7d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:34.287012 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-cdab5c42-fa7f-4c31-b568-863668539a7d None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:34.287941 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-cdab5c42-fa7f-4c31-b568-863668539a7d None None] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:34.290254 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-cdab5c42-fa7f-4c31-b568-863668539a7d None None] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:34.317053 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.context [None req-82967fe4-7212-442a-9102-b4ce91ba439e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cae8762b-f9db-4634-9f99-cd5d65b514f3(cell1) {{(pid=98081) load_cells /opt/stack/nova/nova/context.py:466}} Feb 17 04:35:34.323829 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-82967fe4-7212-442a-9102-b4ce91ba439e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:34.324017 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_db.sqlalchemy.engines [None req-cdab5c42-fa7f-4c31-b568-863668539a7d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=98080) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 17 04:35:34.325727 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-82967fe4-7212-442a-9102-b4ce91ba439e None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:34.326655 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-82967fe4-7212-442a-9102-b4ce91ba439e None None] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:35:34.326858 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_db.sqlalchemy.engines [None req-cdab5c42-fa7f-4c31-b568-863668539a7d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=98080) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 17 04:35:34.328828 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-82967fe4-7212-442a-9102-b4ce91ba439e None None] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:35:34.359716 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_db.sqlalchemy.engines [None req-82967fe4-7212-442a-9102-b4ce91ba439e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=98081) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 17 04:35:34.361168 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_db.sqlalchemy.engines [None req-82967fe4-7212-442a-9102-b4ce91ba439e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=98081) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 17 04:35:34.361850 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_db.sqlalchemy.engines [None req-cdab5c42-fa7f-4c31-b568-863668539a7d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=98080) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 17 04:35:34.393386 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_db.sqlalchemy.engines [None req-82967fe4-7212-442a-9102-b4ce91ba439e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=98081) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 17 04:35:34.449121 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 17 04:35:34.449121 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: from cryptography.utils import int_from_bytes Feb 17 04:35:34.449618 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 17 04:35:34.449618 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: from cryptography.utils import int_from_bytes Feb 17 04:35:34.481179 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 17 04:35:34.481179 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: from cryptography.utils import int_from_bytes Feb 17 04:35:34.481609 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 17 04:35:34.481609 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: from cryptography.utils import int_from_bytes Feb 17 04:35:34.530441 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO keyring.backend [None req-cdab5c42-fa7f-4c31-b568-863668539a7d None None] Loading Gnome Feb 17 04:35:34.553449 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO keyring.backend [None req-cdab5c42-fa7f-4c31-b568-863668539a7d None None] Loading Google Feb 17 04:35:34.558316 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO keyring.backend [None req-cdab5c42-fa7f-4c31-b568-863668539a7d None None] Loading Windows (alt) Feb 17 04:35:34.566877 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO keyring.backend [None req-82967fe4-7212-442a-9102-b4ce91ba439e None None] Loading Gnome Feb 17 04:35:34.567644 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO keyring.backend [None req-cdab5c42-fa7f-4c31-b568-863668539a7d None None] Loading file Feb 17 04:35:34.569765 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO keyring.backend [None req-cdab5c42-fa7f-4c31-b568-863668539a7d None None] Loading keyczar Feb 17 04:35:34.570551 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO keyring.backend [None req-cdab5c42-fa7f-4c31-b568-863668539a7d None None] Loading multi Feb 17 04:35:34.572515 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO keyring.backend [None req-cdab5c42-fa7f-4c31-b568-863668539a7d None None] Loading pyfs Feb 17 04:35:34.589959 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO keyring.backend [None req-82967fe4-7212-442a-9102-b4ce91ba439e None None] Loading Google Feb 17 04:35:34.593495 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO keyring.backend [None req-82967fe4-7212-442a-9102-b4ce91ba439e None None] Loading Windows (alt) Feb 17 04:35:34.598157 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO keyring.backend [None req-82967fe4-7212-442a-9102-b4ce91ba439e None None] Loading file Feb 17 04:35:34.599301 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO keyring.backend [None req-82967fe4-7212-442a-9102-b4ce91ba439e None None] Loading keyczar Feb 17 04:35:34.599773 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO keyring.backend [None req-82967fe4-7212-442a-9102-b4ce91ba439e None None] Loading multi Feb 17 04:35:34.600770 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO keyring.backend [None req-82967fe4-7212-442a-9102-b4ce91ba439e None None] Loading pyfs Feb 17 04:35:34.962862 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: WARNING keystonemiddleware.auth_token [None req-cdab5c42-fa7f-4c31-b568-863668539a7d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 17 04:35:34.972574 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: WARNING keystonemiddleware.auth_token [None req-cdab5c42-fa7f-4c31-b568-863668539a7d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 17 04:35:35.000587 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: WARNING keystonemiddleware.auth_token [None req-82967fe4-7212-442a-9102-b4ce91ba439e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 17 04:35:35.008420 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: WARNING keystonemiddleware.auth_token [None req-82967fe4-7212-442a-9102-b4ce91ba439e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 17 04:35:35.210115 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: WARNING keystonemiddleware.auth_token [None req-cdab5c42-fa7f-4c31-b568-863668539a7d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 17 04:35:35.216238 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: WARNING keystonemiddleware.auth_token [None req-cdab5c42-fa7f-4c31-b568-863668539a7d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 17 04:35:35.221792 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55de86f439c0 pid: 98080 (default app) Feb 17 04:35:35.250952 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: WARNING keystonemiddleware.auth_token [None req-82967fe4-7212-442a-9102-b4ce91ba439e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 17 04:35:35.256645 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: WARNING keystonemiddleware.auth_token [None req-82967fe4-7212-442a-9102-b4ce91ba439e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 17 04:35:35.262719 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55de86f439c0 pid: 98081 (default app) Feb 17 04:36:16.185564 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-e4494412-e18e-4601-8ca4-ea02f9a46e2b tempest-VolumesSnapshotsTestJSON-630310904 tempest-VolumesSnapshotsTestJSON-630310904-project] Action: 'create', calling method: .version_select at 0x7fc2eb4e42f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-876402289"}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:36:16.390759 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-448f9bb0-8986-43b7-a768-9f6f40513d24 tempest-VolumesNegativeTest-1677716625 tempest-VolumesNegativeTest-1677716625-project] Action: 'create', calling method: .version_select at 0x7fc2eb4652f0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1484446697", "metadata": {"Type": "work"}}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:36:16.393548 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-448f9bb0-8986-43b7-a768-9f6f40513d24 tempest-VolumesNegativeTest-1677716625 tempest-VolumesNegativeTest-1677716625-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=98081) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:36:16.394447 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-448f9bb0-8986-43b7-a768-9f6f40513d24 tempest-VolumesNegativeTest-1677716625 tempest-VolumesNegativeTest-1677716625-project] 10.222.0.38 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.661579 Feb 17 04:36:16.398466 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 1/1] 10.222.0.38 () {60 vars in 1146 bytes} [Wed Feb 17 04:36:14 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 1667 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Feb 17 04:36:16.416649 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-8cd6f64b-8179-40d6-95ff-ae88aef0e6a0 tempest-VolumesNegativeTest-1677716625 tempest-VolumesNegativeTest-1677716625-project] Action: 'create', calling method: .version_select at 0x7fc2eb465d08>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-163455457", "metadata": {"Type": "work"}}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:36:16.418185 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-8cd6f64b-8179-40d6-95ff-ae88aef0e6a0 tempest-VolumesNegativeTest-1677716625 tempest-VolumesNegativeTest-1677716625-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=98081) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:36:16.419004 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-8cd6f64b-8179-40d6-95ff-ae88aef0e6a0 tempest-VolumesNegativeTest-1677716625 tempest-VolumesNegativeTest-1677716625-project] 10.222.0.38 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.014472 Feb 17 04:36:16.419600 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 2/2] 10.222.0.38 () {60 vars in 1146 bytes} [Wed Feb 17 04:36:16 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 17 04:36:16.437328 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-98264c70-3458-426d-89ae-89c0780231e2 tempest-VolumesNegativeTest-1677716625 tempest-VolumesNegativeTest-1677716625-project] Action: 'create', calling method: .version_select at 0x7fc2ee988e18>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-432706204", "metadata": {"Type": "work"}}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:36:16.438828 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-98264c70-3458-426d-89ae-89c0780231e2 tempest-VolumesNegativeTest-1677716625 tempest-VolumesNegativeTest-1677716625-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=98081) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:36:16.439682 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-98264c70-3458-426d-89ae-89c0780231e2 tempest-VolumesNegativeTest-1677716625 tempest-VolumesNegativeTest-1677716625-project] 10.222.0.38 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.013900 Feb 17 04:36:16.440418 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 3/3] 10.222.0.38 () {60 vars in 1146 bytes} [Wed Feb 17 04:36:16 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Feb 17 04:36:16.450017 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-8a7fe8fd-bb6e-4cfd-b42e-e62a346b10f8 tempest-VolumesNegativeTest-1677716625 tempest-VolumesNegativeTest-1677716625-project] Calling method '.version_select at 0x7fc2eb465620>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:17.154306 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.wsgi [None req-8a7fe8fd-bb6e-4cfd-b42e-e62a346b10f8 tempest-VolumesNegativeTest-1677716625 tempest-VolumesNegativeTest-1677716625-project] HTTP exception thrown: Volume tempest-invalid-1326017946 could not be found. Feb 17 04:36:17.155268 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-8a7fe8fd-bb6e-4cfd-b42e-e62a346b10f8 tempest-VolumesNegativeTest-1677716625 tempest-VolumesNegativeTest-1677716625-project] Returning 404 to user: Volume tempest-invalid-1326017946 could not be found. {{(pid=98081) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:36:17.156262 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-8a7fe8fd-bb6e-4cfd-b42e-e62a346b10f8 tempest-VolumesNegativeTest-1677716625 tempest-VolumesNegativeTest-1677716625-project] 10.222.0.38 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1326017946" status: 404 len: 99 microversion: 2.1 time: 0.710309 Feb 17 04:36:17.156930 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 4/4] 10.222.0.38 () {58 vars in 1208 bytes} [Wed Feb 17 04:36:16 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-1326017946 => generated 99 bytes in 711 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Feb 17 04:36:17.167653 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-4fbbdff8-7fcf-45a2-8495-619c756bef20 tempest-VolumesNegativeTest-1677716625 tempest-VolumesNegativeTest-1677716625-project] 10.222.0.38 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005205 Feb 17 04:36:17.170544 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 5/5] 10.222.0.38 () {58 vars in 1130 bytes} [Wed Feb 17 04:36:17 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Feb 17 04:36:17.183227 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-78083fa2-c1a4-4d2a-a4c1-575a5ed1b553 tempest-VolumesNegativeTest-1677716625 tempest-VolumesNegativeTest-1677716625-project] 10.222.0.38 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007031 Feb 17 04:36:17.188004 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 6/6] 10.222.0.38 () {58 vars in 1127 bytes} [Wed Feb 17 04:36:17 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Feb 17 04:36:17.201331 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-8df8a99e-152e-4afc-8bd2-2f10d436153a tempest-VolumesNegativeTest-1677716625 tempest-VolumesNegativeTest-1677716625-project] Calling method '.version_select at 0x7fc2eb3f7ea0>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:17.347800 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.wsgi [None req-8df8a99e-152e-4afc-8bd2-2f10d436153a tempest-VolumesNegativeTest-1677716625 tempest-VolumesNegativeTest-1677716625-project] HTTP exception thrown: Volume 8b08ba39-8501-48b3-bbdb-2e434d3740e3 could not be found. Feb 17 04:36:17.348553 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-8df8a99e-152e-4afc-8bd2-2f10d436153a tempest-VolumesNegativeTest-1677716625 tempest-VolumesNegativeTest-1677716625-project] Returning 404 to user: Volume 8b08ba39-8501-48b3-bbdb-2e434d3740e3 could not be found. {{(pid=98081) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:36:17.349573 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-8df8a99e-152e-4afc-8bd2-2f10d436153a tempest-VolumesNegativeTest-1677716625 tempest-VolumesNegativeTest-1677716625-project] 10.222.0.38 "DELETE /compute/v2.1/os-volumes/8b08ba39-8501-48b3-bbdb-2e434d3740e3" status: 404 len: 109 microversion: 2.1 time: 0.156438 Feb 17 04:36:17.351904 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 7/7] 10.222.0.38 () {58 vars in 1238 bytes} [Wed Feb 17 04:36:17 2021] DELETE /compute/v2.1/os-volumes/8b08ba39-8501-48b3-bbdb-2e434d3740e3 => generated 109 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:36:17.362885 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-01511a4f-0615-48ae-a672-93118f887eb7 tempest-VolumesNegativeTest-1677716625 tempest-VolumesNegativeTest-1677716625-project] Calling method '.version_select at 0x7fc2eb414598>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:17.519820 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.wsgi [None req-01511a4f-0615-48ae-a672-93118f887eb7 tempest-VolumesNegativeTest-1677716625 tempest-VolumesNegativeTest-1677716625-project] HTTP exception thrown: Volume 284eef25-9445-4cd6-970a-c200935efb22 could not be found. Feb 17 04:36:17.520585 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-01511a4f-0615-48ae-a672-93118f887eb7 tempest-VolumesNegativeTest-1677716625 tempest-VolumesNegativeTest-1677716625-project] Returning 404 to user: Volume 284eef25-9445-4cd6-970a-c200935efb22 could not be found. {{(pid=98081) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:36:17.522037 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-01511a4f-0615-48ae-a672-93118f887eb7 tempest-VolumesNegativeTest-1677716625 tempest-VolumesNegativeTest-1677716625-project] 10.222.0.38 "GET /compute/v2.1/os-volumes/284eef25-9445-4cd6-970a-c200935efb22" status: 404 len: 109 microversion: 2.1 time: 0.164170 Feb 17 04:36:17.523942 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 8/8] 10.222.0.38 () {58 vars in 1235 bytes} [Wed Feb 17 04:36:17 2021] GET /compute/v2.1/os-volumes/284eef25-9445-4cd6-970a-c200935efb22 => generated 109 bytes in 167 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 17 04:36:18.129046 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-e4494412-e18e-4601-8ca4-ea02f9a46e2b tempest-VolumesSnapshotsTestJSON-630310904 tempest-VolumesSnapshotsTestJSON-630310904-project] 10.222.0.38 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.643255 Feb 17 04:36:18.134637 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 1/9] 10.222.0.38 () {60 vars in 1145 bytes} [Wed Feb 17 04:36:14 2021] POST /compute/v2.1/os-volumes => generated 344 bytes in 3647 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Feb 17 04:36:18.145260 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-54b69045-7333-4e6e-bf41-1b6284aa161a tempest-VolumesSnapshotsTestJSON-630310904 tempest-VolumesSnapshotsTestJSON-630310904-project] Calling method '.version_select at 0x7fc2eb3f7ea0>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:18.313676 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-54b69045-7333-4e6e-bf41-1b6284aa161a tempest-VolumesSnapshotsTestJSON-630310904 tempest-VolumesSnapshotsTestJSON-630310904-project] 10.222.0.38 "GET /compute/v2.1/os-volumes/5ca191c4-ecf5-41c5-92ba-ec31312d8e8b" status: 200 len: 344 microversion: 2.1 time: 0.173787 Feb 17 04:36:18.314520 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 9/10] 10.222.0.38 () {58 vars in 1235 bytes} [Wed Feb 17 04:36:18 2021] GET /compute/v2.1/os-volumes/5ca191c4-ecf5-41c5-92ba-ec31312d8e8b => generated 344 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:36:19.332080 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-b10bc5b3-5497-4a7b-bce2-eaecb58c7d47 tempest-VolumesSnapshotsTestJSON-630310904 tempest-VolumesSnapshotsTestJSON-630310904-project] Calling method '.version_select at 0x7fc2eb4e4ae8>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:19.586641 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-b10bc5b3-5497-4a7b-bce2-eaecb58c7d47 tempest-VolumesSnapshotsTestJSON-630310904 tempest-VolumesSnapshotsTestJSON-630310904-project] 10.222.0.38 "GET /compute/v2.1/os-volumes/5ca191c4-ecf5-41c5-92ba-ec31312d8e8b" status: 200 len: 345 microversion: 2.1 time: 0.262127 Feb 17 04:36:19.587244 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 2/11] 10.222.0.38 () {58 vars in 1235 bytes} [Wed Feb 17 04:36:19 2021] GET /compute/v2.1/os-volumes/5ca191c4-ecf5-41c5-92ba-ec31312d8e8b => generated 345 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:36:19.599090 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-88c8eef1-8e75-439c-b89d-481a813918a3 tempest-VolumesSnapshotsTestJSON-630310904 tempest-VolumesSnapshotsTestJSON-630310904-project] Action: 'create', calling method: .version_select at 0x7fc2eb465f28>, body: {"snapshot": {"volume_id": "5ca191c4-ecf5-41c5-92ba-ec31312d8e8b", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-936957323"}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:36:19.990736 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-88c8eef1-8e75-439c-b89d-481a813918a3 tempest-VolumesSnapshotsTestJSON-630310904 tempest-VolumesSnapshotsTestJSON-630310904-project] 10.222.0.38 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.395426 Feb 17 04:36:19.992179 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 10/12] 10.222.0.38 () {60 vars in 1152 bytes} [Wed Feb 17 04:36:19 2021] POST /compute/v2.1/os-snapshots => generated 286 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:36:20.003811 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-27e7c14e-3d31-47bc-8161-a7bbaba3b1df tempest-VolumesSnapshotsTestJSON-630310904 tempest-VolumesSnapshotsTestJSON-630310904-project] Calling method '.version_select at 0x7fc2eb430c80>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:20.067478 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-27e7c14e-3d31-47bc-8161-a7bbaba3b1df tempest-VolumesSnapshotsTestJSON-630310904 tempest-VolumesSnapshotsTestJSON-630310904-project] 10.222.0.38 "GET /compute/v2.1/os-snapshots/1c28d03b-c327-4c0f-813a-a396fe9e6d0e" status: 200 len: 286 microversion: 2.1 time: 0.068716 Feb 17 04:36:20.070629 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 3/13] 10.222.0.38 () {58 vars in 1241 bytes} [Wed Feb 17 04:36:19 2021] GET /compute/v2.1/os-snapshots/1c28d03b-c327-4c0f-813a-a396fe9e6d0e => generated 286 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:36:20.079788 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-b4dd40ac-a70b-4c05-b125-6d363661ccfe tempest-VolumesSnapshotsTestJSON-630310904 tempest-VolumesSnapshotsTestJSON-630310904-project] Calling method '.version_select at 0x7fc2eb4062f0>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:20.147776 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-b4dd40ac-a70b-4c05-b125-6d363661ccfe tempest-VolumesSnapshotsTestJSON-630310904 tempest-VolumesSnapshotsTestJSON-630310904-project] 10.222.0.38 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.072087 Feb 17 04:36:20.148675 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 11/14] 10.222.0.38 () {58 vars in 1130 bytes} [Wed Feb 17 04:36:20 2021] GET /compute/v2.1/os-snapshots => generated 289 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:36:20.160982 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-1b5f4321-444c-4fc2-b5b5-6eb077a1bfa2 tempest-VolumesSnapshotsTestJSON-630310904 tempest-VolumesSnapshotsTestJSON-630310904-project] Calling method '.version_select at 0x7fc2eb430d90>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:20.295368 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-1b5f4321-444c-4fc2-b5b5-6eb077a1bfa2 tempest-VolumesSnapshotsTestJSON-630310904 tempest-VolumesSnapshotsTestJSON-630310904-project] 10.222.0.38 "GET /compute/v2.1/os-snapshots/1c28d03b-c327-4c0f-813a-a396fe9e6d0e" status: 200 len: 286 microversion: 2.1 time: 0.139281 Feb 17 04:36:20.296237 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 4/15] 10.222.0.38 () {58 vars in 1241 bytes} [Wed Feb 17 04:36:20 2021] GET /compute/v2.1/os-snapshots/1c28d03b-c327-4c0f-813a-a396fe9e6d0e => generated 286 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:36:21.309249 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-0c1c1464-7823-4970-b869-7bd7c8033cce tempest-VolumesSnapshotsTestJSON-630310904 tempest-VolumesSnapshotsTestJSON-630310904-project] Calling method '.version_select at 0x7fc2eb430b70>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:21.412721 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-0c1c1464-7823-4970-b869-7bd7c8033cce tempest-VolumesSnapshotsTestJSON-630310904 tempest-VolumesSnapshotsTestJSON-630310904-project] 10.222.0.38 "GET /compute/v2.1/os-snapshots/1c28d03b-c327-4c0f-813a-a396fe9e6d0e" status: 200 len: 286 microversion: 2.1 time: 0.106935 Feb 17 04:36:21.414146 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 5/16] 10.222.0.38 () {58 vars in 1241 bytes} [Wed Feb 17 04:36:21 2021] GET /compute/v2.1/os-snapshots/1c28d03b-c327-4c0f-813a-a396fe9e6d0e => generated 286 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:36:21.630671 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-629669df-5d34-4073-9574-d5d686a98e9d tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-644605816", "imageRef": "2d6991a7-a1f0-444b-8fd5-d05558b5f9a4", "flavorRef": "452", "networks": [{"uuid": "23d3d8ad-34e2-4a43-aad6-cb91683b7160"}]}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:36:21.843017 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.network.neutron [None req-629669df-5d34-4073-9574-d5d686a98e9d tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] validate_networks() for [('23d3d8ad-34e2-4a43-aad6-cb91683b7160', None, None, None)] {{(pid=98081) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 04:36:22.425982 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-f8e6e12f-f887-4f9d-abc8-a0ee5eb07b00 tempest-VolumesSnapshotsTestJSON-630310904 tempest-VolumesSnapshotsTestJSON-630310904-project] Calling method '.version_select at 0x7fc2eb4308c8>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:22.518184 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-f8e6e12f-f887-4f9d-abc8-a0ee5eb07b00 tempest-VolumesSnapshotsTestJSON-630310904 tempest-VolumesSnapshotsTestJSON-630310904-project] 10.222.0.38 "GET /compute/v2.1/os-snapshots/1c28d03b-c327-4c0f-813a-a396fe9e6d0e" status: 200 len: 286 microversion: 2.1 time: 0.096230 Feb 17 04:36:22.519124 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 6/17] 10.222.0.38 () {58 vars in 1241 bytes} [Wed Feb 17 04:36:22 2021] GET /compute/v2.1/os-snapshots/1c28d03b-c327-4c0f-813a-a396fe9e6d0e => generated 286 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:36:24.012156 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-2264cdcf-a7f4-4e6a-acd5-ca1b73ad9340 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-337838232", "imageRef": "2d6991a7-a1f0-444b-8fd5-d05558b5f9a4", "flavorRef": "452", "networks": [{"uuid": "3eac4670-46fd-4c18-9c55-ed035eb365fd"}]}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:36:24.151172 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.network.neutron [None req-2264cdcf-a7f4-4e6a-acd5-ca1b73ad9340 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] validate_networks() for [('3eac4670-46fd-4c18-9c55-ed035eb365fd', None, None, None)] {{(pid=98080) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 04:36:24.440557 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-629669df-5d34-4073-9574-d5d686a98e9d tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Flavor limits 0:0:0 {{(pid=98081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 04:36:24.441273 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-629669df-5d34-4073-9574-d5d686a98e9d tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Image limits 0:0:0 {{(pid=98081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 04:36:24.442607 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-629669df-5d34-4073-9574-d5d686a98e9d tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Flavor pref 0:0:0 {{(pid=98081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 04:36:24.443245 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-629669df-5d34-4073-9574-d5d686a98e9d tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Image pref 0:0:0 {{(pid=98081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 04:36:24.444020 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-629669df-5d34-4073-9574-d5d686a98e9d tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 04:36:24.463018 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-629669df-5d34-4073-9574-d5d686a98e9d tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:24.466754 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-629669df-5d34-4073-9574-d5d686a98e9d tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:24.469649 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-629669df-5d34-4073-9574-d5d686a98e9d tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:24.470399 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-629669df-5d34-4073-9574-d5d686a98e9d tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:24.511256 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.quota [None req-629669df-5d34-4073-9574-d5d686a98e9d tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Getting quotas for project 7c8bf81d567949c194eb63efc45f5bdd. Resources: {'instances', 'cores', 'ram'} {{(pid=98081) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:36:24.517512 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.quota [None req-629669df-5d34-4073-9574-d5d686a98e9d tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Getting quotas for user 14b74b528e2d4778a5f82cba65fcc178 and project 7c8bf81d567949c194eb63efc45f5bdd. Resources: {'instances', 'cores', 'ram'} {{(pid=98081) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:36:24.535037 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-629669df-5d34-4073-9574-d5d686a98e9d tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Going to run 1 instances... {{(pid=98081) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 04:36:24.539407 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-629669df-5d34-4073-9574-d5d686a98e9d tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] [instance: eef504a5-c89a-46d6-b032-3f78f265ed79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d6991a7-a1f0-444b-8fd5-d05558b5f9a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98081) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 04:36:24.650598 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-629669df-5d34-4073-9574-d5d686a98e9d tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] 10.222.0.38 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.645967 Feb 17 04:36:24.658715 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 12/18] 10.222.0.38 () {60 vars in 1137 bytes} [Wed Feb 17 04:36:21 2021] POST /compute/v2.1/servers => generated 380 bytes in 3657 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 17 04:36:24.670377 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-a990bd44-ba28-4a14-aa4d-a91682fb0a50 tempest-VolumesSnapshotsTestJSON-630310904 tempest-VolumesSnapshotsTestJSON-630310904-project] Calling method '.version_select at 0x7fc2eb406ea0>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:24.746420 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-a990bd44-ba28-4a14-aa4d-a91682fb0a50 tempest-VolumesSnapshotsTestJSON-630310904 tempest-VolumesSnapshotsTestJSON-630310904-project] 10.222.0.38 "GET /compute/v2.1/os-snapshots/1c28d03b-c327-4c0f-813a-a396fe9e6d0e" status: 200 len: 287 microversion: 2.1 time: 0.084465 Feb 17 04:36:24.747146 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 13/19] 10.222.0.38 () {58 vars in 1241 bytes} [Wed Feb 17 04:36:24 2021] GET /compute/v2.1/os-snapshots/1c28d03b-c327-4c0f-813a-a396fe9e6d0e => generated 287 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:36:24.769638 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-560da0f6-a75a-4a00-b80f-266b81842f36 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:24.773928 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-560da0f6-a75a-4a00-b80f-266b81842f36 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] [instance: eef504a5-c89a-46d6-b032-3f78f265ed79] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:24.905862 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-560da0f6-a75a-4a00-b80f-266b81842f36 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b74b528e2d4778a5f82cba65fcc178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c8bf81d567949c194eb63efc45f5bdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:24.927691 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-560da0f6-a75a-4a00-b80f-266b81842f36 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] 10.222.0.38 "GET /compute/v2.1/servers/eef504a5-c89a-46d6-b032-3f78f265ed79" status: 200 len: 1214 microversion: 2.1 time: 0.173450 Feb 17 04:36:24.938626 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 14/20] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:24 2021] GET /compute/v2.1/servers/eef504a5-c89a-46d6-b032-3f78f265ed79 => generated 1214 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:24.943601 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-127346c6-3203-4ccf-b18c-ee24ddfe7dba tempest-VolumesSnapshotsTestJSON-630310904 tempest-VolumesSnapshotsTestJSON-630310904-project] Calling method '.version_select at 0x7fc2eb459950>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:25.265805 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-127346c6-3203-4ccf-b18c-ee24ddfe7dba tempest-VolumesSnapshotsTestJSON-630310904 tempest-VolumesSnapshotsTestJSON-630310904-project] 10.222.0.38 "DELETE /compute/v2.1/os-snapshots/1c28d03b-c327-4c0f-813a-a396fe9e6d0e" status: 202 len: 0 microversion: 2.1 time: 0.336157 Feb 17 04:36:25.266507 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 15/21] 10.222.0.38 () {58 vars in 1244 bytes} [Wed Feb 17 04:36:24 2021] DELETE /compute/v2.1/os-snapshots/1c28d03b-c327-4c0f-813a-a396fe9e6d0e => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:36:25.275139 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-32430b52-b0cc-460a-9d23-ca57aeb3097e tempest-VolumesSnapshotsTestJSON-630310904 tempest-VolumesSnapshotsTestJSON-630310904-project] Calling method '.version_select at 0x7fc2eb2b6d90>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:25.395790 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-32430b52-b0cc-460a-9d23-ca57aeb3097e tempest-VolumesSnapshotsTestJSON-630310904 tempest-VolumesSnapshotsTestJSON-630310904-project] 10.222.0.38 "GET /compute/v2.1/os-snapshots/1c28d03b-c327-4c0f-813a-a396fe9e6d0e" status: 200 len: 286 microversion: 2.1 time: 0.124586 Feb 17 04:36:25.396416 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 16/22] 10.222.0.38 () {58 vars in 1241 bytes} [Wed Feb 17 04:36:25 2021] GET /compute/v2.1/os-snapshots/1c28d03b-c327-4c0f-813a-a396fe9e6d0e => generated 286 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:36:25.800068 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-2264cdcf-a7f4-4e6a-acd5-ca1b73ad9340 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Flavor limits 0:0:0 {{(pid=98080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 04:36:25.801353 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-2264cdcf-a7f4-4e6a-acd5-ca1b73ad9340 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Image limits 0:0:0 {{(pid=98080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 04:36:25.802076 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-2264cdcf-a7f4-4e6a-acd5-ca1b73ad9340 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Flavor pref 0:0:0 {{(pid=98080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 04:36:25.802731 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-2264cdcf-a7f4-4e6a-acd5-ca1b73ad9340 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Image pref 0:0:0 {{(pid=98080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 04:36:25.803504 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-2264cdcf-a7f4-4e6a-acd5-ca1b73ad9340 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 04:36:25.817270 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2264cdcf-a7f4-4e6a-acd5-ca1b73ad9340 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:25.818162 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2264cdcf-a7f4-4e6a-acd5-ca1b73ad9340 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:25.820631 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2264cdcf-a7f4-4e6a-acd5-ca1b73ad9340 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:25.821848 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2264cdcf-a7f4-4e6a-acd5-ca1b73ad9340 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:25.855912 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.quota [None req-2264cdcf-a7f4-4e6a-acd5-ca1b73ad9340 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Getting quotas for project a6284f2b80524eb0a36ccebaedba767a. Resources: {'instances', 'cores', 'ram'} {{(pid=98080) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:36:25.861787 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.quota [None req-2264cdcf-a7f4-4e6a-acd5-ca1b73ad9340 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Getting quotas for user 38a46d18160148f3a48ef4887f6ec7da and project a6284f2b80524eb0a36ccebaedba767a. Resources: {'instances', 'cores', 'ram'} {{(pid=98080) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:36:25.881020 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-2264cdcf-a7f4-4e6a-acd5-ca1b73ad9340 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Going to run 1 instances... {{(pid=98080) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 04:36:25.886000 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-2264cdcf-a7f4-4e6a-acd5-ca1b73ad9340 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: 3ba4c3af-2d1e-4f4a-93e2-0e77d090962d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d6991a7-a1f0-444b-8fd5-d05558b5f9a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98080) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 04:36:25.958272 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-70805641-0657-4aae-baba-ac110e9d4fee tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:25.958995 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-70805641-0657-4aae-baba-ac110e9d4fee tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] [instance: eef504a5-c89a-46d6-b032-3f78f265ed79] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:26.080645 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-2264cdcf-a7f4-4e6a-acd5-ca1b73ad9340 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.672843 Feb 17 04:36:26.081262 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 7/23] 10.222.0.38 () {60 vars in 1137 bytes} [Wed Feb 17 04:36:23 2021] POST /compute/v2.1/servers => generated 380 bytes in 2674 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 17 04:36:26.088908 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-70805641-0657-4aae-baba-ac110e9d4fee tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b74b528e2d4778a5f82cba65fcc178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c8bf81d567949c194eb63efc45f5bdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:26.095258 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-71b575a4-99c8-4b4e-8336-87cd25a0bfbd tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:26.097703 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-71b575a4-99c8-4b4e-8336-87cd25a0bfbd tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: 3ba4c3af-2d1e-4f4a-93e2-0e77d090962d] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:26.099125 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-70805641-0657-4aae-baba-ac110e9d4fee tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] 10.222.0.38 "GET /compute/v2.1/servers/eef504a5-c89a-46d6-b032-3f78f265ed79" status: 200 len: 1214 microversion: 2.1 time: 0.155606 Feb 17 04:36:26.119288 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 17/24] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:25 2021] GET /compute/v2.1/servers/eef504a5-c89a-46d6-b032-3f78f265ed79 => generated 1214 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:26.329800 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-71b575a4-99c8-4b4e-8336-87cd25a0bfbd tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a46d18160148f3a48ef4887f6ec7da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6284f2b80524eb0a36ccebaedba767a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:26.352872 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-71b575a4-99c8-4b4e-8336-87cd25a0bfbd tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "GET /compute/v2.1/servers/3ba4c3af-2d1e-4f4a-93e2-0e77d090962d" status: 200 len: 1217 microversion: 2.1 time: 0.262686 Feb 17 04:36:26.356175 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 8/25] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:26 2021] GET /compute/v2.1/servers/3ba4c3af-2d1e-4f4a-93e2-0e77d090962d => generated 1217 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:26.413757 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-e855287c-137a-45b0-b0d9-7f8535faa782 tempest-VolumesSnapshotsTestJSON-630310904 tempest-VolumesSnapshotsTestJSON-630310904-project] Calling method '.version_select at 0x7fc2eaa6f730>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:26.510360 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.wsgi [None req-e855287c-137a-45b0-b0d9-7f8535faa782 tempest-VolumesSnapshotsTestJSON-630310904 tempest-VolumesSnapshotsTestJSON-630310904-project] HTTP exception thrown: Snapshot 1c28d03b-c327-4c0f-813a-a396fe9e6d0e could not be found. Feb 17 04:36:26.511322 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-e855287c-137a-45b0-b0d9-7f8535faa782 tempest-VolumesSnapshotsTestJSON-630310904 tempest-VolumesSnapshotsTestJSON-630310904-project] Returning 404 to user: Snapshot 1c28d03b-c327-4c0f-813a-a396fe9e6d0e could not be found. {{(pid=98081) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:36:26.512624 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-e855287c-137a-45b0-b0d9-7f8535faa782 tempest-VolumesSnapshotsTestJSON-630310904 tempest-VolumesSnapshotsTestJSON-630310904-project] 10.222.0.38 "GET /compute/v2.1/os-snapshots/1c28d03b-c327-4c0f-813a-a396fe9e6d0e" status: 404 len: 111 microversion: 2.1 time: 0.108609 Feb 17 04:36:26.513439 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 18/26] 10.222.0.38 () {58 vars in 1241 bytes} [Wed Feb 17 04:36:26 2021] GET /compute/v2.1/os-snapshots/1c28d03b-c327-4c0f-813a-a396fe9e6d0e => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:36:26.523303 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-050af588-d8ed-454c-bfd7-6030841dd520 tempest-VolumesSnapshotsTestJSON-630310904 tempest-VolumesSnapshotsTestJSON-630310904-project] Calling method '.version_select at 0x7fc2eb2c4510>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:26.784960 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-050af588-d8ed-454c-bfd7-6030841dd520 tempest-VolumesSnapshotsTestJSON-630310904 tempest-VolumesSnapshotsTestJSON-630310904-project] 10.222.0.38 "DELETE /compute/v2.1/os-volumes/5ca191c4-ecf5-41c5-92ba-ec31312d8e8b" status: 202 len: 0 microversion: 2.1 time: 0.266733 Feb 17 04:36:26.786971 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 9/27] 10.222.0.38 () {58 vars in 1238 bytes} [Wed Feb 17 04:36:26 2021] DELETE /compute/v2.1/os-volumes/5ca191c4-ecf5-41c5-92ba-ec31312d8e8b => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:36:26.802534 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-4bfd68f8-43e8-4acd-b80d-6ed9ac6e2733 tempest-VolumesSnapshotsTestJSON-630310904 tempest-VolumesSnapshotsTestJSON-630310904-project] Calling method '.version_select at 0x7fc2eb2d5598>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:27.057011 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-4bfd68f8-43e8-4acd-b80d-6ed9ac6e2733 tempest-VolumesSnapshotsTestJSON-630310904 tempest-VolumesSnapshotsTestJSON-630310904-project] 10.222.0.38 "GET /compute/v2.1/os-volumes/5ca191c4-ecf5-41c5-92ba-ec31312d8e8b" status: 200 len: 344 microversion: 2.1 time: 0.264680 Feb 17 04:36:27.057754 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 19/28] 10.222.0.38 () {58 vars in 1235 bytes} [Wed Feb 17 04:36:26 2021] GET /compute/v2.1/os-volumes/5ca191c4-ecf5-41c5-92ba-ec31312d8e8b => generated 344 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:36:27.122381 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-50e19ff3-c5e1-4216-ae25-a532db630c3a tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:27.123561 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-50e19ff3-c5e1-4216-ae25-a532db630c3a tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] [instance: eef504a5-c89a-46d6-b032-3f78f265ed79] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:27.322760 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-50e19ff3-c5e1-4216-ae25-a532db630c3a tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b74b528e2d4778a5f82cba65fcc178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c8bf81d567949c194eb63efc45f5bdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:27.344998 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-50e19ff3-c5e1-4216-ae25-a532db630c3a tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] 10.222.0.38 "GET /compute/v2.1/servers/eef504a5-c89a-46d6-b032-3f78f265ed79" status: 200 len: 1214 microversion: 2.1 time: 0.225363 Feb 17 04:36:27.347109 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 10/29] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:27 2021] GET /compute/v2.1/servers/eef504a5-c89a-46d6-b032-3f78f265ed79 => generated 1214 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:27.374609 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-dce9ae73-406e-4d1f-a9b5-2dfdd3985260 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:27.375470 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-dce9ae73-406e-4d1f-a9b5-2dfdd3985260 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: 3ba4c3af-2d1e-4f4a-93e2-0e77d090962d] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:27.512210 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-dce9ae73-406e-4d1f-a9b5-2dfdd3985260 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a46d18160148f3a48ef4887f6ec7da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6284f2b80524eb0a36ccebaedba767a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:27.522502 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-dce9ae73-406e-4d1f-a9b5-2dfdd3985260 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "GET /compute/v2.1/servers/3ba4c3af-2d1e-4f4a-93e2-0e77d090962d" status: 200 len: 1217 microversion: 2.1 time: 0.152503 Feb 17 04:36:27.524055 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 20/30] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:27 2021] GET /compute/v2.1/servers/3ba4c3af-2d1e-4f4a-93e2-0e77d090962d => generated 1217 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:28.073488 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-afb51ad2-556e-44cc-9c1c-25202d7251ed tempest-VolumesSnapshotsTestJSON-630310904 tempest-VolumesSnapshotsTestJSON-630310904-project] Calling method '.version_select at 0x7fc2eb2dfe18>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:28.366673 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-8b997c9f-1e6b-4980-b203-09206cce1fec tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:28.367560 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-8b997c9f-1e6b-4980-b203-09206cce1fec tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] [instance: eef504a5-c89a-46d6-b032-3f78f265ed79] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:28.394184 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8b997c9f-1e6b-4980-b203-09206cce1fec tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:28.394903 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8b997c9f-1e6b-4980-b203-09206cce1fec tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:28.395815 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8b997c9f-1e6b-4980-b203-09206cce1fec tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:28.396316 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8b997c9f-1e6b-4980-b203-09206cce1fec tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:28.563825 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.wsgi [None req-afb51ad2-556e-44cc-9c1c-25202d7251ed tempest-VolumesSnapshotsTestJSON-630310904 tempest-VolumesSnapshotsTestJSON-630310904-project] HTTP exception thrown: Volume 5ca191c4-ecf5-41c5-92ba-ec31312d8e8b could not be found. Feb 17 04:36:28.564546 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-afb51ad2-556e-44cc-9c1c-25202d7251ed tempest-VolumesSnapshotsTestJSON-630310904 tempest-VolumesSnapshotsTestJSON-630310904-project] Returning 404 to user: Volume 5ca191c4-ecf5-41c5-92ba-ec31312d8e8b could not be found. {{(pid=98080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:36:28.565459 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-afb51ad2-556e-44cc-9c1c-25202d7251ed tempest-VolumesSnapshotsTestJSON-630310904 tempest-VolumesSnapshotsTestJSON-630310904-project] 10.222.0.38 "GET /compute/v2.1/os-volumes/5ca191c4-ecf5-41c5-92ba-ec31312d8e8b" status: 404 len: 109 microversion: 2.1 time: 0.498657 Feb 17 04:36:28.569652 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 11/31] 10.222.0.38 () {58 vars in 1235 bytes} [Wed Feb 17 04:36:28 2021] GET /compute/v2.1/os-volumes/5ca191c4-ecf5-41c5-92ba-ec31312d8e8b => generated 109 bytes in 503 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:36:28.587380 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-7c415a06-f365-4089-bb9f-c31e88ece737 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:28.588533 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-7c415a06-f365-4089-bb9f-c31e88ece737 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: 3ba4c3af-2d1e-4f4a-93e2-0e77d090962d] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:28.652344 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7c415a06-f365-4089-bb9f-c31e88ece737 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:28.657011 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7c415a06-f365-4089-bb9f-c31e88ece737 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:28.657933 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7c415a06-f365-4089-bb9f-c31e88ece737 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:28.658431 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7c415a06-f365-4089-bb9f-c31e88ece737 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:28.823603 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-8b997c9f-1e6b-4980-b203-09206cce1fec tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b74b528e2d4778a5f82cba65fcc178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c8bf81d567949c194eb63efc45f5bdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:28.851358 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-8b997c9f-1e6b-4980-b203-09206cce1fec tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] 10.222.0.38 "GET /compute/v2.1/servers/eef504a5-c89a-46d6-b032-3f78f265ed79" status: 200 len: 1266 microversion: 2.1 time: 0.488435 Feb 17 04:36:28.852033 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 21/32] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:28 2021] GET /compute/v2.1/servers/eef504a5-c89a-46d6-b032-3f78f265ed79 => generated 1266 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:28.872546 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-c18899eb-7c74-479d-b6bd-deb1abab142b tempest-VolumesSnapshotsTestJSON-630310904 tempest-VolumesSnapshotsTestJSON-630310904-project] Calling method '.version_select at 0x7fc2ea9f0e18>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:29.094694 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.wsgi [None req-c18899eb-7c74-479d-b6bd-deb1abab142b tempest-VolumesSnapshotsTestJSON-630310904 tempest-VolumesSnapshotsTestJSON-630310904-project] HTTP exception thrown: Volume 5ca191c4-ecf5-41c5-92ba-ec31312d8e8b could not be found. Feb 17 04:36:29.095544 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-c18899eb-7c74-479d-b6bd-deb1abab142b tempest-VolumesSnapshotsTestJSON-630310904 tempest-VolumesSnapshotsTestJSON-630310904-project] Returning 404 to user: Volume 5ca191c4-ecf5-41c5-92ba-ec31312d8e8b could not be found. {{(pid=98081) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:36:29.097603 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-c18899eb-7c74-479d-b6bd-deb1abab142b tempest-VolumesSnapshotsTestJSON-630310904 tempest-VolumesSnapshotsTestJSON-630310904-project] 10.222.0.38 "DELETE /compute/v2.1/os-volumes/5ca191c4-ecf5-41c5-92ba-ec31312d8e8b" status: 404 len: 109 microversion: 2.1 time: 0.232090 Feb 17 04:36:29.099466 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 22/33] 10.222.0.38 () {58 vars in 1238 bytes} [Wed Feb 17 04:36:28 2021] DELETE /compute/v2.1/os-volumes/5ca191c4-ecf5-41c5-92ba-ec31312d8e8b => generated 109 bytes in 247 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:36:29.108550 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-e2dee3bc-a28d-4443-a988-b2e0e8874406 tempest-VolumesSnapshotsTestJSON-630310904 tempest-VolumesSnapshotsTestJSON-630310904-project] Calling method '.version_select at 0x7fc2eb406b70>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:29.121635 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-7c415a06-f365-4089-bb9f-c31e88ece737 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a46d18160148f3a48ef4887f6ec7da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6284f2b80524eb0a36ccebaedba767a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:29.143665 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-7c415a06-f365-4089-bb9f-c31e88ece737 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "GET /compute/v2.1/servers/3ba4c3af-2d1e-4f4a-93e2-0e77d090962d" status: 200 len: 1269 microversion: 2.1 time: 0.570482 Feb 17 04:36:29.144294 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 12/34] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:28 2021] GET /compute/v2.1/servers/3ba4c3af-2d1e-4f4a-93e2-0e77d090962d => generated 1269 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:29.227358 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.wsgi [None req-e2dee3bc-a28d-4443-a988-b2e0e8874406 tempest-VolumesSnapshotsTestJSON-630310904 tempest-VolumesSnapshotsTestJSON-630310904-project] HTTP exception thrown: Volume 5ca191c4-ecf5-41c5-92ba-ec31312d8e8b could not be found. Feb 17 04:36:29.229047 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-e2dee3bc-a28d-4443-a988-b2e0e8874406 tempest-VolumesSnapshotsTestJSON-630310904 tempest-VolumesSnapshotsTestJSON-630310904-project] Returning 404 to user: Volume 5ca191c4-ecf5-41c5-92ba-ec31312d8e8b could not be found. {{(pid=98081) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:36:29.230298 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-e2dee3bc-a28d-4443-a988-b2e0e8874406 tempest-VolumesSnapshotsTestJSON-630310904 tempest-VolumesSnapshotsTestJSON-630310904-project] 10.222.0.38 "GET /compute/v2.1/os-volumes/5ca191c4-ecf5-41c5-92ba-ec31312d8e8b" status: 404 len: 109 microversion: 2.1 time: 0.126677 Feb 17 04:36:29.231961 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 23/35] 10.222.0.38 () {58 vars in 1235 bytes} [Wed Feb 17 04:36:29 2021] GET /compute/v2.1/os-volumes/5ca191c4-ecf5-41c5-92ba-ec31312d8e8b => generated 109 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 17 04:36:29.870541 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-bfcfa2e7-ca4c-47dd-bcac-705e14074ffb tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:29.871740 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-bfcfa2e7-ca4c-47dd-bcac-705e14074ffb tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] [instance: eef504a5-c89a-46d6-b032-3f78f265ed79] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:29.901893 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-bfcfa2e7-ca4c-47dd-bcac-705e14074ffb tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:29.915636 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-bfcfa2e7-ca4c-47dd-bcac-705e14074ffb tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:29.918971 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-bfcfa2e7-ca4c-47dd-bcac-705e14074ffb tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:29.919633 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-bfcfa2e7-ca4c-47dd-bcac-705e14074ffb tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:30.167074 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-47db7811-42ba-4ba5-93b0-e19169bf62e6 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:30.167933 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-47db7811-42ba-4ba5-93b0-e19169bf62e6 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: 3ba4c3af-2d1e-4f4a-93e2-0e77d090962d] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:30.184895 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-47db7811-42ba-4ba5-93b0-e19169bf62e6 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:30.185687 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-47db7811-42ba-4ba5-93b0-e19169bf62e6 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:30.189295 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-47db7811-42ba-4ba5-93b0-e19169bf62e6 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:30.190498 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-47db7811-42ba-4ba5-93b0-e19169bf62e6 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:30.745433 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-bfcfa2e7-ca4c-47dd-bcac-705e14074ffb tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b74b528e2d4778a5f82cba65fcc178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c8bf81d567949c194eb63efc45f5bdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:30.762700 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-bfcfa2e7-ca4c-47dd-bcac-705e14074ffb tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] 10.222.0.38 "GET /compute/v2.1/servers/eef504a5-c89a-46d6-b032-3f78f265ed79" status: 200 len: 1272 microversion: 2.1 time: 0.895998 Feb 17 04:36:30.763549 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 13/36] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:29 2021] GET /compute/v2.1/servers/eef504a5-c89a-46d6-b032-3f78f265ed79 => generated 1272 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:30.883183 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-47db7811-42ba-4ba5-93b0-e19169bf62e6 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a46d18160148f3a48ef4887f6ec7da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6284f2b80524eb0a36ccebaedba767a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:30.902616 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-47db7811-42ba-4ba5-93b0-e19169bf62e6 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "GET /compute/v2.1/servers/3ba4c3af-2d1e-4f4a-93e2-0e77d090962d" status: 200 len: 1275 microversion: 2.1 time: 0.739905 Feb 17 04:36:30.903510 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 24/37] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:30 2021] GET /compute/v2.1/servers/3ba4c3af-2d1e-4f4a-93e2-0e77d090962d => generated 1275 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:36:31.781952 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-c9d44d21-b1b6-41e8-ab01-9d5673230730 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:31.783155 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-c9d44d21-b1b6-41e8-ab01-9d5673230730 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] [instance: eef504a5-c89a-46d6-b032-3f78f265ed79] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:31.802182 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c9d44d21-b1b6-41e8-ab01-9d5673230730 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:31.808377 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c9d44d21-b1b6-41e8-ab01-9d5673230730 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:31.809902 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c9d44d21-b1b6-41e8-ab01-9d5673230730 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:31.811075 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c9d44d21-b1b6-41e8-ab01-9d5673230730 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:31.923012 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-8a09792e-ed5b-4d01-a896-5233b7718382 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:31.923894 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-8a09792e-ed5b-4d01-a896-5233b7718382 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: 3ba4c3af-2d1e-4f4a-93e2-0e77d090962d] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:31.964989 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8a09792e-ed5b-4d01-a896-5233b7718382 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:31.965503 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8a09792e-ed5b-4d01-a896-5233b7718382 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:31.966374 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8a09792e-ed5b-4d01-a896-5233b7718382 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:31.967718 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8a09792e-ed5b-4d01-a896-5233b7718382 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:32.281319 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-c9d44d21-b1b6-41e8-ab01-9d5673230730 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b74b528e2d4778a5f82cba65fcc178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c8bf81d567949c194eb63efc45f5bdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:32.298352 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-c9d44d21-b1b6-41e8-ab01-9d5673230730 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] 10.222.0.38 "GET /compute/v2.1/servers/eef504a5-c89a-46d6-b032-3f78f265ed79" status: 200 len: 1272 microversion: 2.1 time: 0.520399 Feb 17 04:36:32.302342 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 14/38] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:31 2021] GET /compute/v2.1/servers/eef504a5-c89a-46d6-b032-3f78f265ed79 => generated 1272 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:32.452688 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-8a09792e-ed5b-4d01-a896-5233b7718382 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a46d18160148f3a48ef4887f6ec7da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6284f2b80524eb0a36ccebaedba767a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:32.470691 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-8a09792e-ed5b-4d01-a896-5233b7718382 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "GET /compute/v2.1/servers/3ba4c3af-2d1e-4f4a-93e2-0e77d090962d" status: 200 len: 1275 microversion: 2.1 time: 0.552870 Feb 17 04:36:32.481842 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 25/39] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:31 2021] GET /compute/v2.1/servers/3ba4c3af-2d1e-4f4a-93e2-0e77d090962d => generated 1275 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:33.327031 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-37f56592-5c88-4890-af47-cdb0df510938 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:33.330383 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-37f56592-5c88-4890-af47-cdb0df510938 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] [instance: eef504a5-c89a-46d6-b032-3f78f265ed79] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:33.359147 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-37f56592-5c88-4890-af47-cdb0df510938 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:33.360038 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-37f56592-5c88-4890-af47-cdb0df510938 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:33.368846 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-37f56592-5c88-4890-af47-cdb0df510938 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:33.369456 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-37f56592-5c88-4890-af47-cdb0df510938 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:33.489979 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-caf6fd52-5a29-4c10-9807-25315e3fce1d tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:33.490799 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-caf6fd52-5a29-4c10-9807-25315e3fce1d tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: 3ba4c3af-2d1e-4f4a-93e2-0e77d090962d] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:33.511209 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-caf6fd52-5a29-4c10-9807-25315e3fce1d tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:33.516748 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-caf6fd52-5a29-4c10-9807-25315e3fce1d tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:33.524975 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-caf6fd52-5a29-4c10-9807-25315e3fce1d tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:33.525711 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-caf6fd52-5a29-4c10-9807-25315e3fce1d tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:35.863249 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-37f56592-5c88-4890-af47-cdb0df510938 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b74b528e2d4778a5f82cba65fcc178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c8bf81d567949c194eb63efc45f5bdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:35.883807 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-37f56592-5c88-4890-af47-cdb0df510938 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] 10.222.0.38 "GET /compute/v2.1/servers/eef504a5-c89a-46d6-b032-3f78f265ed79" status: 200 len: 1314 microversion: 2.1 time: 2.562939 Feb 17 04:36:35.885580 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 15/40] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:33 2021] GET /compute/v2.1/servers/eef504a5-c89a-46d6-b032-3f78f265ed79 => generated 1314 bytes in 2567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:36.383351 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-caf6fd52-5a29-4c10-9807-25315e3fce1d tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a46d18160148f3a48ef4887f6ec7da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6284f2b80524eb0a36ccebaedba767a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:36.409278 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-caf6fd52-5a29-4c10-9807-25315e3fce1d tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "GET /compute/v2.1/servers/3ba4c3af-2d1e-4f4a-93e2-0e77d090962d" status: 200 len: 1317 microversion: 2.1 time: 2.923661 Feb 17 04:36:36.418089 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 26/41] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:33 2021] GET /compute/v2.1/servers/3ba4c3af-2d1e-4f4a-93e2-0e77d090962d => generated 1317 bytes in 2933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:36.829998 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-87f75f80-9498-4bf7-ab0e-1cc8a7288bbb tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Action: 'create', calling method: .version_select at 0x7fc2eaa17ea0>, body: {"keypair": {"name": "tempest-keypair-1955402104"}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:36:36.918098 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-56f56c89-0335-4e6d-9ff1-55495cc4c68b tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:36.919393 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-56f56c89-0335-4e6d-9ff1-55495cc4c68b tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] [instance: eef504a5-c89a-46d6-b032-3f78f265ed79] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:36.940936 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.quota [None req-87f75f80-9498-4bf7-ab0e-1cc8a7288bbb tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Getting quotas for project 669aa7253aff4985a447b249c23aa338. Resources: {'key_pairs'} {{(pid=98080) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:36:36.961426 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.quota [None req-87f75f80-9498-4bf7-ab0e-1cc8a7288bbb tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Getting quotas for user 24b1af7d956f42a19ef0e6a9a753b2bd and project 669aa7253aff4985a447b249c23aa338. Resources: {'key_pairs'} {{(pid=98080) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:36:36.971522 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-56f56c89-0335-4e6d-9ff1-55495cc4c68b tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:36.980022 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-56f56c89-0335-4e6d-9ff1-55495cc4c68b tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:36.981848 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-56f56c89-0335-4e6d-9ff1-55495cc4c68b tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:36.984813 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-56f56c89-0335-4e6d-9ff1-55495cc4c68b tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:37.545253 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.quota [None req-87f75f80-9498-4bf7-ab0e-1cc8a7288bbb tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Getting quotas for project 669aa7253aff4985a447b249c23aa338. Resources: {'key_pairs'} {{(pid=98080) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:36:37.559886 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.quota [None req-87f75f80-9498-4bf7-ab0e-1cc8a7288bbb tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Getting quotas for user 24b1af7d956f42a19ef0e6a9a753b2bd and project 669aa7253aff4985a447b249c23aa338. Resources: {'key_pairs'} {{(pid=98080) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:36:37.581904 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-87f75f80-9498-4bf7-ab0e-1cc8a7288bbb tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 1.694284 Feb 17 04:36:37.583402 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 16/42] 10.222.0.38 () {62 vars in 1189 bytes} [Wed Feb 17 04:36:35 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 1697 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Feb 17 04:36:37.605077 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-9b9bed87-7eea-457d-a3e2-cd9653fb471a tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:37.607606 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-9b9bed87-7eea-457d-a3e2-cd9653fb471a tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: 3ba4c3af-2d1e-4f4a-93e2-0e77d090962d] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:37.632915 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9b9bed87-7eea-457d-a3e2-cd9653fb471a tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:37.633928 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9b9bed87-7eea-457d-a3e2-cd9653fb471a tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:37.636819 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9b9bed87-7eea-457d-a3e2-cd9653fb471a tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:37.637333 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9b9bed87-7eea-457d-a3e2-cd9653fb471a tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:37.690144 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-56f56c89-0335-4e6d-9ff1-55495cc4c68b tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b74b528e2d4778a5f82cba65fcc178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c8bf81d567949c194eb63efc45f5bdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:37.700994 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-56f56c89-0335-4e6d-9ff1-55495cc4c68b tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] 10.222.0.38 "GET /compute/v2.1/servers/eef504a5-c89a-46d6-b032-3f78f265ed79" status: 200 len: 1314 microversion: 2.1 time: 0.800484 Feb 17 04:36:37.708563 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 27/43] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:36 2021] GET /compute/v2.1/servers/eef504a5-c89a-46d6-b032-3f78f265ed79 => generated 1314 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:38.647594 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-9b9bed87-7eea-457d-a3e2-cd9653fb471a tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a46d18160148f3a48ef4887f6ec7da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6284f2b80524eb0a36ccebaedba767a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:38.658899 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-9b9bed87-7eea-457d-a3e2-cd9653fb471a tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "GET /compute/v2.1/servers/3ba4c3af-2d1e-4f4a-93e2-0e77d090962d" status: 200 len: 1317 microversion: 2.1 time: 1.074349 Feb 17 04:36:38.692589 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 17/44] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:37 2021] GET /compute/v2.1/servers/3ba4c3af-2d1e-4f4a-93e2-0e77d090962d => generated 1317 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:39.389932 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-a5fd8a04-5b93-4817-8870-b208ada995ba tempest-VolumesGetTestJSON-200090799 tempest-VolumesGetTestJSON-200090799-project] Action: 'create', calling method: .version_select at 0x7fc2eaa087b8>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-667144786", "metadata": {"Type": "work"}}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:36:39.527411 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-5c21cdf1-eaaa-4cde-947c-b9e2208eae54 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1710939935", "imageRef": "2d6991a7-a1f0-444b-8fd5-d05558b5f9a4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f0d9ef39-b46a-4056-80ca-b8257246fc13"}]}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:36:39.705761 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.network.neutron [None req-5c21cdf1-eaaa-4cde-947c-b9e2208eae54 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] validate_networks() for [('f0d9ef39-b46a-4056-80ca-b8257246fc13', None, None, None)] {{(pid=98080) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 04:36:41.272935 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-a5fd8a04-5b93-4817-8870-b208ada995ba tempest-VolumesGetTestJSON-200090799 tempest-VolumesGetTestJSON-200090799-project] 10.222.0.38 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 2.598429 Feb 17 04:36:41.283761 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 28/45] 10.222.0.38 () {60 vars in 1146 bytes} [Wed Feb 17 04:36:38 2021] POST /compute/v2.1/os-volumes => generated 352 bytes in 2610 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Feb 17 04:36:41.290531 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-0e4a1890-508e-4dcc-8116-8efb7477b532 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:41.294796 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-0e4a1890-508e-4dcc-8116-8efb7477b532 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] [instance: eef504a5-c89a-46d6-b032-3f78f265ed79] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:41.310899 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0e4a1890-508e-4dcc-8116-8efb7477b532 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:41.311812 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0e4a1890-508e-4dcc-8116-8efb7477b532 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:41.312824 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0e4a1890-508e-4dcc-8116-8efb7477b532 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:41.314555 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0e4a1890-508e-4dcc-8116-8efb7477b532 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:43.856175 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-0e4a1890-508e-4dcc-8116-8efb7477b532 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b74b528e2d4778a5f82cba65fcc178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c8bf81d567949c194eb63efc45f5bdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:43.880575 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-0e4a1890-508e-4dcc-8116-8efb7477b532 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] 10.222.0.38 "GET /compute/v2.1/servers/eef504a5-c89a-46d6-b032-3f78f265ed79" status: 200 len: 1314 microversion: 2.1 time: 2.594970 Feb 17 04:36:43.882690 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 29/46] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:41 2021] GET /compute/v2.1/servers/eef504a5-c89a-46d6-b032-3f78f265ed79 => generated 1314 bytes in 2598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:43.887634 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-96743524-4184-444d-8d14-30a78417db4a tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:43.888525 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-96743524-4184-444d-8d14-30a78417db4a tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: 3ba4c3af-2d1e-4f4a-93e2-0e77d090962d] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:43.914195 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-96743524-4184-444d-8d14-30a78417db4a tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:43.914887 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-96743524-4184-444d-8d14-30a78417db4a tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:43.915989 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-96743524-4184-444d-8d14-30a78417db4a tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:43.916627 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-96743524-4184-444d-8d14-30a78417db4a tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:44.674465 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-5c21cdf1-eaaa-4cde-947c-b9e2208eae54 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Flavor limits 0:0:0 {{(pid=98080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 04:36:44.675359 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-5c21cdf1-eaaa-4cde-947c-b9e2208eae54 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Image limits 0:0:0 {{(pid=98080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 04:36:44.676178 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-5c21cdf1-eaaa-4cde-947c-b9e2208eae54 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Flavor pref 0:0:0 {{(pid=98080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 04:36:44.677142 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-5c21cdf1-eaaa-4cde-947c-b9e2208eae54 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Image pref 0:0:0 {{(pid=98080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 04:36:44.678921 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-5c21cdf1-eaaa-4cde-947c-b9e2208eae54 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 04:36:44.692809 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5c21cdf1-eaaa-4cde-947c-b9e2208eae54 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:44.693933 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5c21cdf1-eaaa-4cde-947c-b9e2208eae54 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:44.695383 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5c21cdf1-eaaa-4cde-947c-b9e2208eae54 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:44.696091 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5c21cdf1-eaaa-4cde-947c-b9e2208eae54 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:44.723668 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.quota [None req-5c21cdf1-eaaa-4cde-947c-b9e2208eae54 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Getting quotas for project d94a26ff4de24165a4a8fc5a5ddfd3f5. Resources: {'instances', 'cores', 'ram'} {{(pid=98080) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:36:44.729460 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.quota [None req-5c21cdf1-eaaa-4cde-947c-b9e2208eae54 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Getting quotas for user 6163f256863b4d51a3950fea5f517838 and project d94a26ff4de24165a4a8fc5a5ddfd3f5. Resources: {'instances', 'cores', 'ram'} {{(pid=98080) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:36:44.751606 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-5c21cdf1-eaaa-4cde-947c-b9e2208eae54 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Going to run 1 instances... {{(pid=98080) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 04:36:44.756380 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-5c21cdf1-eaaa-4cde-947c-b9e2208eae54 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 68a5c561-c418-4a68-b8b3-1600b638b80c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d6991a7-a1f0-444b-8fd5-d05558b5f9a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98080) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 04:36:44.869176 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-5c21cdf1-eaaa-4cde-947c-b9e2208eae54 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 6.175328 Feb 17 04:36:44.870052 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 18/47] 10.222.0.38 () {60 vars in 1137 bytes} [Wed Feb 17 04:36:38 2021] POST /compute/v2.1/servers => generated 383 bytes in 6177 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 17 04:36:44.875382 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-9409a7d7-0963-43b3-ba77-4f82cf11098e tempest-VolumesGetTestJSON-200090799 tempest-VolumesGetTestJSON-200090799-project] Calling method '.version_select at 0x7fc2eaa170d0>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:44.957887 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-96743524-4184-444d-8d14-30a78417db4a tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a46d18160148f3a48ef4887f6ec7da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6284f2b80524eb0a36ccebaedba767a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:44.984559 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-96743524-4184-444d-8d14-30a78417db4a tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "GET /compute/v2.1/servers/3ba4c3af-2d1e-4f4a-93e2-0e77d090962d" status: 200 len: 1317 microversion: 2.1 time: 1.100482 Feb 17 04:36:44.985558 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 30/48] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:43 2021] GET /compute/v2.1/servers/3ba4c3af-2d1e-4f4a-93e2-0e77d090962d => generated 1317 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:44.992036 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-87f8d59e-8273-4349-8ad6-ed1f892fdac2 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1468575517", "imageRef": "2d6991a7-a1f0-444b-8fd5-d05558b5f9a4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cee8cd42-e9ee-4d26-a68b-5f13a2055c3a"}], "security_groups": [{"name": "tempest-securitygroup--1558062285"}], "key_name": "tempest-keypair-1955402104", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:36:45.087202 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-9409a7d7-0963-43b3-ba77-4f82cf11098e tempest-VolumesGetTestJSON-200090799 tempest-VolumesGetTestJSON-200090799-project] 10.222.0.38 "GET /compute/v2.1/os-volumes/b5849634-e09b-4297-9bc5-5e3014f0610c" status: 200 len: 353 microversion: 2.1 time: 0.215708 Feb 17 04:36:45.087841 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 19/49] 10.222.0.38 () {58 vars in 1235 bytes} [Wed Feb 17 04:36:44 2021] GET /compute/v2.1/os-volumes/b5849634-e09b-4297-9bc5-5e3014f0610c => generated 353 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:36:45.092956 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-9c11943d-e1c4-456e-87f3-d78cf02f5b45 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:45.093799 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-9c11943d-e1c4-456e-87f3-d78cf02f5b45 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 68a5c561-c418-4a68-b8b3-1600b638b80c] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:45.401990 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-9c11943d-e1c4-456e-87f3-d78cf02f5b45 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:45.430239 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-9c11943d-e1c4-456e-87f3-d78cf02f5b45 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c" status: 200 len: 1222 microversion: 2.1 time: 0.338770 Feb 17 04:36:45.433054 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 20/50] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:45 2021] GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c => generated 1222 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:45.454009 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-d8d1d746-b47c-4993-84e7-1b4c18033ec2 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:45.456973 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-d8d1d746-b47c-4993-84e7-1b4c18033ec2 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] [instance: eef504a5-c89a-46d6-b032-3f78f265ed79] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:45.476106 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d8d1d746-b47c-4993-84e7-1b4c18033ec2 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:45.476650 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d8d1d746-b47c-4993-84e7-1b4c18033ec2 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:45.477940 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d8d1d746-b47c-4993-84e7-1b4c18033ec2 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:45.479090 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d8d1d746-b47c-4993-84e7-1b4c18033ec2 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:45.774873 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.network.neutron [None req-87f8d59e-8273-4349-8ad6-ed1f892fdac2 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] validate_networks() for [('cee8cd42-e9ee-4d26-a68b-5f13a2055c3a', None, None, None)] {{(pid=98081) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 04:36:46.775692 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-d8d1d746-b47c-4993-84e7-1b4c18033ec2 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b74b528e2d4778a5f82cba65fcc178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c8bf81d567949c194eb63efc45f5bdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:46.798888 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-d8d1d746-b47c-4993-84e7-1b4c18033ec2 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] 10.222.0.38 "GET /compute/v2.1/servers/eef504a5-c89a-46d6-b032-3f78f265ed79" status: 200 len: 1314 microversion: 2.1 time: 1.364536 Feb 17 04:36:46.799500 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 21/51] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:45 2021] GET /compute/v2.1/servers/eef504a5-c89a-46d6-b032-3f78f265ed79 => generated 1314 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:46.816227 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-27f0d805-ba3e-4d86-8018-76129e482160 tempest-VolumesGetTestJSON-200090799 tempest-VolumesGetTestJSON-200090799-project] Calling method '.version_select at 0x7fc2ea9d89d8>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:47.071583 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-27f0d805-ba3e-4d86-8018-76129e482160 tempest-VolumesGetTestJSON-200090799 tempest-VolumesGetTestJSON-200090799-project] 10.222.0.38 "GET /compute/v2.1/os-volumes/b5849634-e09b-4297-9bc5-5e3014f0610c" status: 200 len: 353 microversion: 2.1 time: 0.266453 Feb 17 04:36:47.072697 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 22/52] 10.222.0.38 () {58 vars in 1235 bytes} [Wed Feb 17 04:36:46 2021] GET /compute/v2.1/os-volumes/b5849634-e09b-4297-9bc5-5e3014f0610c => generated 353 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:36:47.078187 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-14850e36-5847-48ad-8fc1-1950d6b9713a tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-630159967", "imageRef": "2d6991a7-a1f0-444b-8fd5-d05558b5f9a4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f0d9ef39-b46a-4056-80ca-b8257246fc13"}]}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:36:47.251229 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.network.neutron [None req-14850e36-5847-48ad-8fc1-1950d6b9713a tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] validate_networks() for [('f0d9ef39-b46a-4056-80ca-b8257246fc13', None, None, None)] {{(pid=98080) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 04:36:48.246072 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-87f8d59e-8273-4349-8ad6-ed1f892fdac2 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Flavor limits 0:0:0 {{(pid=98081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 04:36:48.247288 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-87f8d59e-8273-4349-8ad6-ed1f892fdac2 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Image limits 0:0:0 {{(pid=98081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 04:36:48.248030 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-87f8d59e-8273-4349-8ad6-ed1f892fdac2 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Flavor pref 0:0:0 {{(pid=98081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 04:36:48.248621 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-87f8d59e-8273-4349-8ad6-ed1f892fdac2 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Image pref 0:0:0 {{(pid=98081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 04:36:48.249237 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-87f8d59e-8273-4349-8ad6-ed1f892fdac2 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 04:36:48.259154 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-87f8d59e-8273-4349-8ad6-ed1f892fdac2 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:48.259825 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-87f8d59e-8273-4349-8ad6-ed1f892fdac2 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:48.260935 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-87f8d59e-8273-4349-8ad6-ed1f892fdac2 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:48.261641 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-87f8d59e-8273-4349-8ad6-ed1f892fdac2 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:48.284594 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.quota [None req-87f8d59e-8273-4349-8ad6-ed1f892fdac2 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Getting quotas for project 669aa7253aff4985a447b249c23aa338. Resources: {'instances', 'cores', 'ram'} {{(pid=98081) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:36:48.289804 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.quota [None req-87f8d59e-8273-4349-8ad6-ed1f892fdac2 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Getting quotas for user 24b1af7d956f42a19ef0e6a9a753b2bd and project 669aa7253aff4985a447b249c23aa338. Resources: {'instances', 'cores', 'ram'} {{(pid=98081) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:36:48.301980 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-87f8d59e-8273-4349-8ad6-ed1f892fdac2 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Going to run 1 instances... {{(pid=98081) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 04:36:48.305523 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-87f8d59e-8273-4349-8ad6-ed1f892fdac2 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d6991a7-a1f0-444b-8fd5-d05558b5f9a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98081) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 04:36:48.358610 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-87f8d59e-8273-4349-8ad6-ed1f892fdac2 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.371753 Feb 17 04:36:48.359692 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 31/53] 10.222.0.38 () {62 vars in 1178 bytes} [Wed Feb 17 04:36:44 2021] POST /compute/v2.1/servers => generated 402 bytes in 3373 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Feb 17 04:36:48.371442 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-801bdbf8-8b8b-4272-a32e-1842c6d6b77e tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:48.372341 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-801bdbf8-8b8b-4272-a32e-1842c6d6b77e tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: 3ba4c3af-2d1e-4f4a-93e2-0e77d090962d] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:48.390122 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-801bdbf8-8b8b-4272-a32e-1842c6d6b77e tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:48.391060 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-801bdbf8-8b8b-4272-a32e-1842c6d6b77e tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:48.392171 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-801bdbf8-8b8b-4272-a32e-1842c6d6b77e tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:48.393090 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-801bdbf8-8b8b-4272-a32e-1842c6d6b77e tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:49.423760 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-801bdbf8-8b8b-4272-a32e-1842c6d6b77e tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a46d18160148f3a48ef4887f6ec7da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6284f2b80524eb0a36ccebaedba767a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:49.450823 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-801bdbf8-8b8b-4272-a32e-1842c6d6b77e tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "GET /compute/v2.1/servers/3ba4c3af-2d1e-4f4a-93e2-0e77d090962d" status: 200 len: 1317 microversion: 2.1 time: 1.083251 Feb 17 04:36:49.451455 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 32/54] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:48 2021] GET /compute/v2.1/servers/3ba4c3af-2d1e-4f4a-93e2-0e77d090962d => generated 1317 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:49.601119 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-14850e36-5847-48ad-8fc1-1950d6b9713a tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Flavor limits 0:0:0 {{(pid=98080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 04:36:49.602004 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-14850e36-5847-48ad-8fc1-1950d6b9713a tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Image limits 0:0:0 {{(pid=98080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 04:36:49.603481 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-14850e36-5847-48ad-8fc1-1950d6b9713a tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Flavor pref 0:0:0 {{(pid=98080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 04:36:49.604098 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-14850e36-5847-48ad-8fc1-1950d6b9713a tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Image pref 0:0:0 {{(pid=98080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 04:36:49.604823 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-14850e36-5847-48ad-8fc1-1950d6b9713a tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 04:36:49.616098 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-14850e36-5847-48ad-8fc1-1950d6b9713a tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:49.616819 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-14850e36-5847-48ad-8fc1-1950d6b9713a tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:49.617848 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-14850e36-5847-48ad-8fc1-1950d6b9713a tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:49.618476 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-14850e36-5847-48ad-8fc1-1950d6b9713a tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:49.638655 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.quota [None req-14850e36-5847-48ad-8fc1-1950d6b9713a tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Getting quotas for project d94a26ff4de24165a4a8fc5a5ddfd3f5. Resources: {'instances', 'cores', 'ram'} {{(pid=98080) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:36:49.643180 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.quota [None req-14850e36-5847-48ad-8fc1-1950d6b9713a tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Getting quotas for user 6163f256863b4d51a3950fea5f517838 and project d94a26ff4de24165a4a8fc5a5ddfd3f5. Resources: {'instances', 'cores', 'ram'} {{(pid=98080) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:36:49.655424 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-14850e36-5847-48ad-8fc1-1950d6b9713a tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Going to run 1 instances... {{(pid=98080) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 04:36:49.658306 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-14850e36-5847-48ad-8fc1-1950d6b9713a tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 1c099afc-d941-4044-83cc-39185d6d57b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d6991a7-a1f0-444b-8fd5-d05558b5f9a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98080) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 04:36:49.717569 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-14850e36-5847-48ad-8fc1-1950d6b9713a tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.643574 Feb 17 04:36:49.718430 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 23/55] 10.222.0.38 () {60 vars in 1137 bytes} [Wed Feb 17 04:36:47 2021] POST /compute/v2.1/servers => generated 383 bytes in 2645 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 17 04:36:49.722961 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-b762fdd6-15b5-41ce-bacd-7748e9fbc07f tempest-VolumesGetTestJSON-200090799 tempest-VolumesGetTestJSON-200090799-project] Calling method '.version_select at 0x7fc2ea9d8400>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:49.783651 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [req-fc085aef-24a8-4432-8939-5d976d3f4596 req-08794235-f2b1-4783-928d-58fbfb384443 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eef504a5-c89a-46d6-b032-3f78f265ed79", "tag": "9be13024-0135-468a-a333-ad54ca5b0575"}]} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:36:49.786142 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:36:49.786142 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:36:49.806074 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-fc085aef-24a8-4432-8939-5d976d3f4596 req-08794235-f2b1-4783-928d-58fbfb384443 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:49.808368 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-fc085aef-24a8-4432-8939-5d976d3f4596 req-08794235-f2b1-4783-928d-58fbfb384443 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:49.853253 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-b762fdd6-15b5-41ce-bacd-7748e9fbc07f tempest-VolumesGetTestJSON-200090799 tempest-VolumesGetTestJSON-200090799-project] 10.222.0.38 "DELETE /compute/v2.1/os-volumes/b5849634-e09b-4297-9bc5-5e3014f0610c" status: 202 len: 0 microversion: 2.1 time: 0.133381 Feb 17 04:36:49.853966 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.compute.server_external_events [req-fc085aef-24a8-4432-8939-5d976d3f4596 req-08794235-f2b1-4783-928d-58fbfb384443 service nova] Creating event network-changed:9be13024-0135-468a-a333-ad54ca5b0575 for instance eef504a5-c89a-46d6-b032-3f78f265ed79 on hv-cinder-76019 Feb 17 04:36:49.854723 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 24/56] 10.222.0.38 () {58 vars in 1238 bytes} [Wed Feb 17 04:36:49 2021] DELETE /compute/v2.1/os-volumes/b5849634-e09b-4297-9bc5-5e3014f0610c => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:36:49.862462 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-f883bbdb-0a43-4101-bcb9-2c75bc3002a4 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:49.863369 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-f883bbdb-0a43-4101-bcb9-2c75bc3002a4 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] [instance: eef504a5-c89a-46d6-b032-3f78f265ed79] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:49.865295 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-fc085aef-24a8-4432-8939-5d976d3f4596 req-08794235-f2b1-4783-928d-58fbfb384443 service nova] Acquired lock "compute-rpcapi-router" {{(pid=98081) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Feb 17 04:36:49.866674 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6960ea1c-501e-48a3-b7b3-b40c940dcfad None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:49.867230 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6960ea1c-501e-48a3-b7b3-b40c940dcfad None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:49.868375 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6960ea1c-501e-48a3-b7b3-b40c940dcfad None None] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:49.868872 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6960ea1c-501e-48a3-b7b3-b40c940dcfad None None] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:49.875727 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f883bbdb-0a43-4101-bcb9-2c75bc3002a4 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:49.876589 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f883bbdb-0a43-4101-bcb9-2c75bc3002a4 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:49.878358 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f883bbdb-0a43-4101-bcb9-2c75bc3002a4 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:49.879088 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f883bbdb-0a43-4101-bcb9-2c75bc3002a4 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:49.898685 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.compute.rpcapi [None req-6960ea1c-501e-48a3-b7b3-b40c940dcfad None None] Automatically selected compute RPC version 5.13 from minimum service version 54 Feb 17 04:36:49.901992 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6960ea1c-501e-48a3-b7b3-b40c940dcfad None None] Releasing lock "compute-rpcapi-router" {{(pid=98081) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Feb 17 04:36:49.947398 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-6960ea1c-501e-48a3-b7b3-b40c940dcfad None None] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.480559 Feb 17 04:36:49.950766 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 33/57] 10.222.0.38 () {64 vars in 1308 bytes} [Wed Feb 17 04:36:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:36:49.956890 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-ec72719f-565a-4e19-86ac-42dbad669680 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:49.957951 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-ec72719f-565a-4e19-86ac-42dbad669680 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:49.967736 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ec72719f-565a-4e19-86ac-42dbad669680 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:49.968444 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ec72719f-565a-4e19-86ac-42dbad669680 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:49.969432 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ec72719f-565a-4e19-86ac-42dbad669680 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:49.970081 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ec72719f-565a-4e19-86ac-42dbad669680 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:50.138597 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-ec72719f-565a-4e19-86ac-42dbad669680 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:50.152255 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-ec72719f-565a-4e19-86ac-42dbad669680 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:50.153800 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-ec72719f-565a-4e19-86ac-42dbad669680 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:50.154939 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-ec72719f-565a-4e19-86ac-42dbad669680 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1334 microversion: 2.20 time: 0.202797 Feb 17 04:36:50.157105 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 34/58] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:36:49 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1334 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:36:50.163152 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-26a67a44-1429-4c35-b221-86c9e8f32503 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:50.163827 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-26a67a44-1429-4c35-b221-86c9e8f32503 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 1c099afc-d941-4044-83cc-39185d6d57b0] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:50.310020 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-26a67a44-1429-4c35-b221-86c9e8f32503 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:50.324811 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-26a67a44-1429-4c35-b221-86c9e8f32503 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0" status: 200 len: 1221 microversion: 2.1 time: 0.166533 Feb 17 04:36:50.325432 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 35/59] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:50 2021] GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0 => generated 1221 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:50.339663 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-6e0cae4c-f972-47ab-b0d8-b1cde62676ad tempest-VolumesGetTestJSON-200090799 tempest-VolumesGetTestJSON-200090799-project] Calling method '.version_select at 0x7fc2ea9577b8>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:50.345105 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-f883bbdb-0a43-4101-bcb9-2c75bc3002a4 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b74b528e2d4778a5f82cba65fcc178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c8bf81d567949c194eb63efc45f5bdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:50.359804 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-f883bbdb-0a43-4101-bcb9-2c75bc3002a4 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] 10.222.0.38 "GET /compute/v2.1/servers/eef504a5-c89a-46d6-b032-3f78f265ed79" status: 200 len: 1314 microversion: 2.1 time: 0.503799 Feb 17 04:36:50.361132 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 25/60] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:49 2021] GET /compute/v2.1/servers/eef504a5-c89a-46d6-b032-3f78f265ed79 => generated 1314 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:50.470103 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-968840ed-2e9a-4e1a-803d-6ff7dbc78b79 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:50.471595 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-968840ed-2e9a-4e1a-803d-6ff7dbc78b79 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: 3ba4c3af-2d1e-4f4a-93e2-0e77d090962d] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:50.477960 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-6e0cae4c-f972-47ab-b0d8-b1cde62676ad tempest-VolumesGetTestJSON-200090799 tempest-VolumesGetTestJSON-200090799-project] 10.222.0.38 "GET /compute/v2.1/os-volumes/b5849634-e09b-4297-9bc5-5e3014f0610c" status: 200 len: 352 microversion: 2.1 time: 0.151025 Feb 17 04:36:50.478664 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 36/61] 10.222.0.38 () {58 vars in 1235 bytes} [Wed Feb 17 04:36:50 2021] GET /compute/v2.1/os-volumes/b5849634-e09b-4297-9bc5-5e3014f0610c => generated 352 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:36:50.487695 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-968840ed-2e9a-4e1a-803d-6ff7dbc78b79 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:50.488204 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-968840ed-2e9a-4e1a-803d-6ff7dbc78b79 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:50.490933 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-968840ed-2e9a-4e1a-803d-6ff7dbc78b79 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:50.491606 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-968840ed-2e9a-4e1a-803d-6ff7dbc78b79 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:50.747005 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-968840ed-2e9a-4e1a-803d-6ff7dbc78b79 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a46d18160148f3a48ef4887f6ec7da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6284f2b80524eb0a36ccebaedba767a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:50.756466 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-968840ed-2e9a-4e1a-803d-6ff7dbc78b79 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "GET /compute/v2.1/servers/3ba4c3af-2d1e-4f4a-93e2-0e77d090962d" status: 200 len: 1317 microversion: 2.1 time: 0.292222 Feb 17 04:36:50.767023 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 26/62] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:50 2021] GET /compute/v2.1/servers/3ba4c3af-2d1e-4f4a-93e2-0e77d090962d => generated 1317 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:36:51.176640 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-e1adc074-dde7-4903-8f01-cba1653ff0a3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:51.177637 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-e1adc074-dde7-4903-8f01-cba1653ff0a3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:51.186062 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e1adc074-dde7-4903-8f01-cba1653ff0a3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:51.186889 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e1adc074-dde7-4903-8f01-cba1653ff0a3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:51.187954 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e1adc074-dde7-4903-8f01-cba1653ff0a3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:51.188642 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e1adc074-dde7-4903-8f01-cba1653ff0a3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:51.242772 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [req-e94cbdce-7053-4ee6-8218-fe6b1a0188ef req-a7685ae4-ba20-4c8a-9006-b82ce55e9fe2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68a5c561-c418-4a68-b8b3-1600b638b80c", "tag": "931d3091-bc84-4f99-9fec-11c4d1500c28"}]} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:36:51.244485 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:36:51.244485 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:36:51.256475 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-e94cbdce-7053-4ee6-8218-fe6b1a0188ef req-a7685ae4-ba20-4c8a-9006-b82ce55e9fe2 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:51.256978 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-e94cbdce-7053-4ee6-8218-fe6b1a0188ef req-a7685ae4-ba20-4c8a-9006-b82ce55e9fe2 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:51.283250 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.compute.server_external_events [req-e94cbdce-7053-4ee6-8218-fe6b1a0188ef req-a7685ae4-ba20-4c8a-9006-b82ce55e9fe2 service nova] Creating event network-changed:931d3091-bc84-4f99-9fec-11c4d1500c28 for instance 68a5c561-c418-4a68-b8b3-1600b638b80c on hv-cinder-76019 Feb 17 04:36:51.289538 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [req-e94cbdce-7053-4ee6-8218-fe6b1a0188ef req-a7685ae4-ba20-4c8a-9006-b82ce55e9fe2 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.191074 Feb 17 04:36:51.290544 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 37/63] 10.222.0.38 () {64 vars in 1308 bytes} [Wed Feb 17 04:36:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:36:51.337957 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-e1adc074-dde7-4903-8f01-cba1653ff0a3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:51.343927 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-5393f3b0-8b10-44b2-b5df-153af5cdeebe tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:51.344685 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-5393f3b0-8b10-44b2-b5df-153af5cdeebe tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 1c099afc-d941-4044-83cc-39185d6d57b0] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:51.346343 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-e1adc074-dde7-4903-8f01-cba1653ff0a3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:51.347972 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-e1adc074-dde7-4903-8f01-cba1653ff0a3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:51.349808 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-e1adc074-dde7-4903-8f01-cba1653ff0a3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1334 microversion: 2.20 time: 0.176471 Feb 17 04:36:51.350375 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 27/64] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:36:51 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1334 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:36:51.355778 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5393f3b0-8b10-44b2-b5df-153af5cdeebe tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:51.356290 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5393f3b0-8b10-44b2-b5df-153af5cdeebe tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:51.357140 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5393f3b0-8b10-44b2-b5df-153af5cdeebe tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:51.357636 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5393f3b0-8b10-44b2-b5df-153af5cdeebe tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:51.377793 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-0ce1e14b-e52f-4ba8-91ce-bb3492bac5bb tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:51.378607 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-0ce1e14b-e52f-4ba8-91ce-bb3492bac5bb tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] [instance: eef504a5-c89a-46d6-b032-3f78f265ed79] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:51.391588 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0ce1e14b-e52f-4ba8-91ce-bb3492bac5bb tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:51.392237 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0ce1e14b-e52f-4ba8-91ce-bb3492bac5bb tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:51.393086 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0ce1e14b-e52f-4ba8-91ce-bb3492bac5bb tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:51.393587 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0ce1e14b-e52f-4ba8-91ce-bb3492bac5bb tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:51.522502 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-5393f3b0-8b10-44b2-b5df-153af5cdeebe tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:51.537361 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-5393f3b0-8b10-44b2-b5df-153af5cdeebe tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0" status: 200 len: 1225 microversion: 2.1 time: 0.196981 Feb 17 04:36:51.538686 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 38/65] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:51 2021] GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0 => generated 1225 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:36:51.545197 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-417fc493-7656-4655-ab12-885ac560544e tempest-VolumesGetTestJSON-200090799 tempest-VolumesGetTestJSON-200090799-project] Calling method '.version_select at 0x7fc2eaa08bf8>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:51.667590 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-417fc493-7656-4655-ab12-885ac560544e tempest-VolumesGetTestJSON-200090799 tempest-VolumesGetTestJSON-200090799-project] 10.222.0.38 "GET /compute/v2.1/os-volumes/b5849634-e09b-4297-9bc5-5e3014f0610c" status: 200 len: 352 microversion: 2.1 time: 0.125420 Feb 17 04:36:51.668557 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 39/66] 10.222.0.38 () {58 vars in 1235 bytes} [Wed Feb 17 04:36:51 2021] GET /compute/v2.1/os-volumes/b5849634-e09b-4297-9bc5-5e3014f0610c => generated 352 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:36:51.777243 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-fcb64bce-2291-4d6d-ba3a-1b1df1ff51dd tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:51.778107 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-fcb64bce-2291-4d6d-ba3a-1b1df1ff51dd tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: 3ba4c3af-2d1e-4f4a-93e2-0e77d090962d] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:51.793473 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-0ce1e14b-e52f-4ba8-91ce-bb3492bac5bb tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b74b528e2d4778a5f82cba65fcc178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c8bf81d567949c194eb63efc45f5bdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:51.795087 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-fcb64bce-2291-4d6d-ba3a-1b1df1ff51dd tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:51.795608 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-fcb64bce-2291-4d6d-ba3a-1b1df1ff51dd tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:51.796601 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-fcb64bce-2291-4d6d-ba3a-1b1df1ff51dd tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:51.797228 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-fcb64bce-2291-4d6d-ba3a-1b1df1ff51dd tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:51.817245 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-0ce1e14b-e52f-4ba8-91ce-bb3492bac5bb tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] 10.222.0.38 "GET /compute/v2.1/servers/eef504a5-c89a-46d6-b032-3f78f265ed79" status: 200 len: 1314 microversion: 2.1 time: 0.443603 Feb 17 04:36:51.829288 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 28/67] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:51 2021] GET /compute/v2.1/servers/eef504a5-c89a-46d6-b032-3f78f265ed79 => generated 1314 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:36:51.972281 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [req-77809018-27b6-4d56-95be-51e1966b813f req-e8ba6da0-7fbb-460c-a5dd-3b09a0ddce0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ba4c3af-2d1e-4f4a-93e2-0e77d090962d", "tag": "d92a1575-fc75-4375-9949-9d1f0f507388"}]} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:36:51.976256 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:36:51.976256 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:36:51.994994 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-77809018-27b6-4d56-95be-51e1966b813f req-e8ba6da0-7fbb-460c-a5dd-3b09a0ddce0d service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:51.996033 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-77809018-27b6-4d56-95be-51e1966b813f req-e8ba6da0-7fbb-460c-a5dd-3b09a0ddce0d service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:52.018193 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.compute.server_external_events [req-77809018-27b6-4d56-95be-51e1966b813f req-e8ba6da0-7fbb-460c-a5dd-3b09a0ddce0d service nova] Creating event network-changed:d92a1575-fc75-4375-9949-9d1f0f507388 for instance 3ba4c3af-2d1e-4f4a-93e2-0e77d090962d on hv-cinder-76019 Feb 17 04:36:52.018968 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-77809018-27b6-4d56-95be-51e1966b813f req-e8ba6da0-7fbb-460c-a5dd-3b09a0ddce0d service nova] Acquired lock "compute-rpcapi-router" {{(pid=98080) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Feb 17 04:36:52.020868 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9bc8778e-26f2-4153-9f0e-4830c44237a5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:52.021401 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9bc8778e-26f2-4153-9f0e-4830c44237a5 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:52.022279 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9bc8778e-26f2-4153-9f0e-4830c44237a5 None None] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:52.022815 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9bc8778e-26f2-4153-9f0e-4830c44237a5 None None] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:52.033612 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.compute.rpcapi [None req-9bc8778e-26f2-4153-9f0e-4830c44237a5 None None] Automatically selected compute RPC version 5.13 from minimum service version 54 Feb 17 04:36:52.034982 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9bc8778e-26f2-4153-9f0e-4830c44237a5 None None] Releasing lock "compute-rpcapi-router" {{(pid=98080) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Feb 17 04:36:52.067881 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-fcb64bce-2291-4d6d-ba3a-1b1df1ff51dd tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a46d18160148f3a48ef4887f6ec7da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6284f2b80524eb0a36ccebaedba767a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:52.082884 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-fcb64bce-2291-4d6d-ba3a-1b1df1ff51dd tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "GET /compute/v2.1/servers/3ba4c3af-2d1e-4f4a-93e2-0e77d090962d" status: 200 len: 1317 microversion: 2.1 time: 0.312337 Feb 17 04:36:52.083778 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 40/68] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:51 2021] GET /compute/v2.1/servers/3ba4c3af-2d1e-4f4a-93e2-0e77d090962d => generated 1317 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:36:52.089469 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-9bc8778e-26f2-4153-9f0e-4830c44237a5 None None] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122097 Feb 17 04:36:52.090135 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 29/69] 10.222.0.38 () {64 vars in 1308 bytes} [Wed Feb 17 04:36:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:36:52.369341 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-f692ad53-cbeb-41ec-92cf-b7125ae4637a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:52.369941 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-f692ad53-cbeb-41ec-92cf-b7125ae4637a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:52.377642 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f692ad53-cbeb-41ec-92cf-b7125ae4637a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:52.378142 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f692ad53-cbeb-41ec-92cf-b7125ae4637a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:52.379473 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f692ad53-cbeb-41ec-92cf-b7125ae4637a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:52.379970 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f692ad53-cbeb-41ec-92cf-b7125ae4637a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:52.508698 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-f692ad53-cbeb-41ec-92cf-b7125ae4637a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:52.518085 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-f692ad53-cbeb-41ec-92cf-b7125ae4637a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:52.519819 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-f692ad53-cbeb-41ec-92cf-b7125ae4637a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:52.520996 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-f692ad53-cbeb-41ec-92cf-b7125ae4637a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1334 microversion: 2.20 time: 0.155844 Feb 17 04:36:52.521868 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 41/70] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:36:52 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1334 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:36:52.556927 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-15d2d9f5-96da-4dfd-9658-4b87efd98f9d tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:52.557695 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-15d2d9f5-96da-4dfd-9658-4b87efd98f9d tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 1c099afc-d941-4044-83cc-39185d6d57b0] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:52.565970 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-15d2d9f5-96da-4dfd-9658-4b87efd98f9d tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:52.566473 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-15d2d9f5-96da-4dfd-9658-4b87efd98f9d tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:52.567370 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-15d2d9f5-96da-4dfd-9658-4b87efd98f9d tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:52.567914 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-15d2d9f5-96da-4dfd-9658-4b87efd98f9d tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:52.681296 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-de02704a-7cc2-41f4-8ff6-7af35fbaf89a tempest-VolumesGetTestJSON-200090799 tempest-VolumesGetTestJSON-200090799-project] Calling method '.version_select at 0x7fc2ea8e8488>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:52.705612 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-15d2d9f5-96da-4dfd-9658-4b87efd98f9d tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:52.726554 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-15d2d9f5-96da-4dfd-9658-4b87efd98f9d tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0" status: 200 len: 1225 microversion: 2.1 time: 0.174773 Feb 17 04:36:52.727228 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 30/71] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:52 2021] GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0 => generated 1225 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:52.830430 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-de02704a-7cc2-41f4-8ff6-7af35fbaf89a tempest-VolumesGetTestJSON-200090799 tempest-VolumesGetTestJSON-200090799-project] 10.222.0.38 "GET /compute/v2.1/os-volumes/b5849634-e09b-4297-9bc5-5e3014f0610c" status: 200 len: 352 microversion: 2.1 time: 0.153483 Feb 17 04:36:52.831086 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 42/72] 10.222.0.38 () {58 vars in 1235 bytes} [Wed Feb 17 04:36:52 2021] GET /compute/v2.1/os-volumes/b5849634-e09b-4297-9bc5-5e3014f0610c => generated 352 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:36:52.840519 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-078817df-c4e4-4f51-bad0-f7cfebb9e218 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:52.842228 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-078817df-c4e4-4f51-bad0-f7cfebb9e218 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] [instance: eef504a5-c89a-46d6-b032-3f78f265ed79] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:52.854615 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-078817df-c4e4-4f51-bad0-f7cfebb9e218 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:52.855462 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-078817df-c4e4-4f51-bad0-f7cfebb9e218 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:52.859004 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-078817df-c4e4-4f51-bad0-f7cfebb9e218 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:52.859766 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-078817df-c4e4-4f51-bad0-f7cfebb9e218 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:53.101311 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-2a3a68e8-3fde-4b65-ad09-b60c4e29181f tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:53.101978 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-2a3a68e8-3fde-4b65-ad09-b60c4e29181f tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: 3ba4c3af-2d1e-4f4a-93e2-0e77d090962d] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:53.331923 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2a3a68e8-3fde-4b65-ad09-b60c4e29181f tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:53.332433 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2a3a68e8-3fde-4b65-ad09-b60c4e29181f tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:53.333281 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2a3a68e8-3fde-4b65-ad09-b60c4e29181f tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:53.334171 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2a3a68e8-3fde-4b65-ad09-b60c4e29181f tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:54.078845 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-078817df-c4e4-4f51-bad0-f7cfebb9e218 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b74b528e2d4778a5f82cba65fcc178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c8bf81d567949c194eb63efc45f5bdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:54.089397 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-078817df-c4e4-4f51-bad0-f7cfebb9e218 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] 10.222.0.38 "GET /compute/v2.1/servers/eef504a5-c89a-46d6-b032-3f78f265ed79" status: 200 len: 1314 microversion: 2.1 time: 1.256923 Feb 17 04:36:54.110678 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 31/73] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:52 2021] GET /compute/v2.1/servers/eef504a5-c89a-46d6-b032-3f78f265ed79 => generated 1314 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:54.116459 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-3bf9364c-23d4-47e4-a331-8d3d5f34ed0a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:54.117354 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-3bf9364c-23d4-47e4-a331-8d3d5f34ed0a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:54.127342 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-3bf9364c-23d4-47e4-a331-8d3d5f34ed0a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:54.128036 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-3bf9364c-23d4-47e4-a331-8d3d5f34ed0a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:54.129148 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-3bf9364c-23d4-47e4-a331-8d3d5f34ed0a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:54.129810 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-3bf9364c-23d4-47e4-a331-8d3d5f34ed0a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:54.585630 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-3bf9364c-23d4-47e4-a331-8d3d5f34ed0a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:54.607238 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-3bf9364c-23d4-47e4-a331-8d3d5f34ed0a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:54.609311 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-3bf9364c-23d4-47e4-a331-8d3d5f34ed0a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:54.612743 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-3bf9364c-23d4-47e4-a331-8d3d5f34ed0a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1340 microversion: 2.20 time: 0.500896 Feb 17 04:36:54.617715 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 32/74] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:36:54 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1340 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:36:54.632599 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-dbb1dfb2-2669-41b2-bfd2-f7b4c6f52cec tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:54.633576 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-dbb1dfb2-2669-41b2-bfd2-f7b4c6f52cec tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 1c099afc-d941-4044-83cc-39185d6d57b0] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:54.653780 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-dbb1dfb2-2669-41b2-bfd2-f7b4c6f52cec tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:54.659109 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-dbb1dfb2-2669-41b2-bfd2-f7b4c6f52cec tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:54.660254 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-dbb1dfb2-2669-41b2-bfd2-f7b4c6f52cec tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:54.661060 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-dbb1dfb2-2669-41b2-bfd2-f7b4c6f52cec tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:54.758609 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-2a3a68e8-3fde-4b65-ad09-b60c4e29181f tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a46d18160148f3a48ef4887f6ec7da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6284f2b80524eb0a36ccebaedba767a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:54.770510 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-2a3a68e8-3fde-4b65-ad09-b60c4e29181f tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "GET /compute/v2.1/servers/3ba4c3af-2d1e-4f4a-93e2-0e77d090962d" status: 200 len: 1317 microversion: 2.1 time: 1.673348 Feb 17 04:36:54.781240 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 43/75] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:53 2021] GET /compute/v2.1/servers/3ba4c3af-2d1e-4f4a-93e2-0e77d090962d => generated 1317 bytes in 1685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:54.799016 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-b211d183-26c9-4eff-b473-d0252fcceca2 tempest-VolumesGetTestJSON-200090799 tempest-VolumesGetTestJSON-200090799-project] Calling method '.version_select at 0x7fc2ee97c1e0>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:54.890271 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.wsgi [None req-b211d183-26c9-4eff-b473-d0252fcceca2 tempest-VolumesGetTestJSON-200090799 tempest-VolumesGetTestJSON-200090799-project] HTTP exception thrown: Volume b5849634-e09b-4297-9bc5-5e3014f0610c could not be found. Feb 17 04:36:54.890983 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-b211d183-26c9-4eff-b473-d0252fcceca2 tempest-VolumesGetTestJSON-200090799 tempest-VolumesGetTestJSON-200090799-project] Returning 404 to user: Volume b5849634-e09b-4297-9bc5-5e3014f0610c could not be found. {{(pid=98081) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:36:54.891889 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-b211d183-26c9-4eff-b473-d0252fcceca2 tempest-VolumesGetTestJSON-200090799 tempest-VolumesGetTestJSON-200090799-project] 10.222.0.38 "GET /compute/v2.1/os-volumes/b5849634-e09b-4297-9bc5-5e3014f0610c" status: 404 len: 109 microversion: 2.1 time: 0.109482 Feb 17 04:36:54.892467 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 44/76] 10.222.0.38 () {58 vars in 1235 bytes} [Wed Feb 17 04:36:54 2021] GET /compute/v2.1/os-volumes/b5849634-e09b-4297-9bc5-5e3014f0610c => generated 109 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:36:54.967415 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-dbb1dfb2-2669-41b2-bfd2-f7b4c6f52cec tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:54.984786 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-dbb1dfb2-2669-41b2-bfd2-f7b4c6f52cec tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0" status: 200 len: 1279 microversion: 2.1 time: 0.364797 Feb 17 04:36:54.985567 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 33/77] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:54 2021] GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0 => generated 1279 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:55.115269 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-9ac36068-c38d-43e6-b265-b8e5e7de05f7 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:55.115938 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-9ac36068-c38d-43e6-b265-b8e5e7de05f7 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] [instance: eef504a5-c89a-46d6-b032-3f78f265ed79] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:55.136449 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9ac36068-c38d-43e6-b265-b8e5e7de05f7 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:55.136999 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9ac36068-c38d-43e6-b265-b8e5e7de05f7 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:55.137858 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9ac36068-c38d-43e6-b265-b8e5e7de05f7 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:55.138365 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9ac36068-c38d-43e6-b265-b8e5e7de05f7 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:55.643323 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-fb4589e0-5a6d-4f67-860f-f997b6649f6b tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:55.644979 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-fb4589e0-5a6d-4f67-860f-f997b6649f6b tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:55.667551 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-fb4589e0-5a6d-4f67-860f-f997b6649f6b tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:55.668393 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-fb4589e0-5a6d-4f67-860f-f997b6649f6b tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:55.672008 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-fb4589e0-5a6d-4f67-860f-f997b6649f6b tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:55.672732 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-fb4589e0-5a6d-4f67-860f-f997b6649f6b tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:56.105652 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-fb4589e0-5a6d-4f67-860f-f997b6649f6b tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:56.122256 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-fb4589e0-5a6d-4f67-860f-f997b6649f6b tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:56.126017 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-fb4589e0-5a6d-4f67-860f-f997b6649f6b tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:56.127302 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-fb4589e0-5a6d-4f67-860f-f997b6649f6b tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1340 microversion: 2.20 time: 0.493281 Feb 17 04:36:56.127971 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 34/78] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:36:55 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1340 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:36:56.139634 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-340e63d6-010a-4a89-8fb6-24b189b4f593 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:56.140385 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-340e63d6-010a-4a89-8fb6-24b189b4f593 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: 3ba4c3af-2d1e-4f4a-93e2-0e77d090962d] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:56.172967 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-340e63d6-010a-4a89-8fb6-24b189b4f593 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:56.173481 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-340e63d6-010a-4a89-8fb6-24b189b4f593 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:56.174896 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-340e63d6-010a-4a89-8fb6-24b189b4f593 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:56.174999 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-340e63d6-010a-4a89-8fb6-24b189b4f593 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:56.314176 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-9ac36068-c38d-43e6-b265-b8e5e7de05f7 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b74b528e2d4778a5f82cba65fcc178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c8bf81d567949c194eb63efc45f5bdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:56.337903 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-9ac36068-c38d-43e6-b265-b8e5e7de05f7 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] 10.222.0.38 "GET /compute/v2.1/servers/eef504a5-c89a-46d6-b032-3f78f265ed79" status: 200 len: 1314 microversion: 2.1 time: 1.228691 Feb 17 04:36:56.339860 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 45/79] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:55 2021] GET /compute/v2.1/servers/eef504a5-c89a-46d6-b032-3f78f265ed79 => generated 1314 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:56.361891 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-0291824d-4adc-476d-b1df-2a241d178740 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:56.362661 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-0291824d-4adc-476d-b1df-2a241d178740 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 1c099afc-d941-4044-83cc-39185d6d57b0] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:56.379980 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0291824d-4adc-476d-b1df-2a241d178740 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:56.381293 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0291824d-4adc-476d-b1df-2a241d178740 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:56.383078 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0291824d-4adc-476d-b1df-2a241d178740 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:56.388133 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0291824d-4adc-476d-b1df-2a241d178740 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:57.146979 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-0291824d-4adc-476d-b1df-2a241d178740 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:57.148948 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-340e63d6-010a-4a89-8fb6-24b189b4f593 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a46d18160148f3a48ef4887f6ec7da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6284f2b80524eb0a36ccebaedba767a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:57.172174 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-340e63d6-010a-4a89-8fb6-24b189b4f593 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "GET /compute/v2.1/servers/3ba4c3af-2d1e-4f4a-93e2-0e77d090962d" status: 200 len: 1317 microversion: 2.1 time: 1.040469 Feb 17 04:36:57.174281 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-0291824d-4adc-476d-b1df-2a241d178740 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0" status: 200 len: 1321 microversion: 2.1 time: 0.833195 Feb 17 04:36:57.175268 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 35/80] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:56 2021] GET /compute/v2.1/servers/3ba4c3af-2d1e-4f4a-93e2-0e77d090962d => generated 1317 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:57.176718 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 46/81] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:56 2021] GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0 => generated 1321 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:57.194921 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-ff21aa06-6fd8-4e18-b925-2e1beff31b34 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:57.210970 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-ff21aa06-6fd8-4e18-b925-2e1beff31b34 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:57.227382 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ff21aa06-6fd8-4e18-b925-2e1beff31b34 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:57.233728 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ff21aa06-6fd8-4e18-b925-2e1beff31b34 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:57.234851 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ff21aa06-6fd8-4e18-b925-2e1beff31b34 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:57.235488 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ff21aa06-6fd8-4e18-b925-2e1beff31b34 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:57.447754 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [req-f8c0d1d4-37a2-4762-8dad-eec998c5c509 req-252bbacd-4855-443b-a56d-0799072ce171 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ba4c3af-2d1e-4f4a-93e2-0e77d090962d", "name": "network-vif-plugged", "status": "completed", "tag": "d92a1575-fc75-4375-9949-9d1f0f507388"}]} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:36:57.449454 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:36:57.449454 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:36:57.460648 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-f8c0d1d4-37a2-4762-8dad-eec998c5c509 req-252bbacd-4855-443b-a56d-0799072ce171 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:57.461162 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-f8c0d1d4-37a2-4762-8dad-eec998c5c509 req-252bbacd-4855-443b-a56d-0799072ce171 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:57.483218 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.compute.server_external_events [req-f8c0d1d4-37a2-4762-8dad-eec998c5c509 req-252bbacd-4855-443b-a56d-0799072ce171 service nova] Creating event network-vif-plugged:d92a1575-fc75-4375-9949-9d1f0f507388 for instance 3ba4c3af-2d1e-4f4a-93e2-0e77d090962d on hv-cinder-76019 Feb 17 04:36:57.490166 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [req-f8c0d1d4-37a2-4762-8dad-eec998c5c509 req-252bbacd-4855-443b-a56d-0799072ce171 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.300580 Feb 17 04:36:57.491014 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 36/82] 10.222.0.38 () {64 vars in 1308 bytes} [Wed Feb 17 04:36:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:36:57.496928 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-d3d0d903-cdbd-4c37-bb5c-318a3b1c387e tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:57.497862 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-d3d0d903-cdbd-4c37-bb5c-318a3b1c387e tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] [instance: eef504a5-c89a-46d6-b032-3f78f265ed79] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:57.509202 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d3d0d903-cdbd-4c37-bb5c-318a3b1c387e tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:57.510043 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d3d0d903-cdbd-4c37-bb5c-318a3b1c387e tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:57.511096 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d3d0d903-cdbd-4c37-bb5c-318a3b1c387e tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:57.511789 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d3d0d903-cdbd-4c37-bb5c-318a3b1c387e tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:57.712228 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-ff21aa06-6fd8-4e18-b925-2e1beff31b34 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:57.721861 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-ff21aa06-6fd8-4e18-b925-2e1beff31b34 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:57.723643 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-ff21aa06-6fd8-4e18-b925-2e1beff31b34 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:57.725218 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-ff21aa06-6fd8-4e18-b925-2e1beff31b34 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1340 microversion: 2.20 time: 0.534894 Feb 17 04:36:57.725785 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 47/83] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:36:57 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1340 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:36:58.048433 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-d3d0d903-cdbd-4c37-bb5c-318a3b1c387e tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b74b528e2d4778a5f82cba65fcc178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c8bf81d567949c194eb63efc45f5bdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:58.058521 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-d3d0d903-cdbd-4c37-bb5c-318a3b1c387e tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] 10.222.0.38 "GET /compute/v2.1/servers/eef504a5-c89a-46d6-b032-3f78f265ed79" status: 200 len: 1314 microversion: 2.1 time: 0.566145 Feb 17 04:36:58.059758 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 37/84] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:57 2021] GET /compute/v2.1/servers/eef504a5-c89a-46d6-b032-3f78f265ed79 => generated 1314 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:58.194538 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-5bfac5a8-05a7-48ae-9350-2575c339e730 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:58.195393 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-cfdf5f8c-012a-4c0f-b740-e2cb65e61b75 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:58.195906 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-5bfac5a8-05a7-48ae-9350-2575c339e730 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: 3ba4c3af-2d1e-4f4a-93e2-0e77d090962d] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:58.196029 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-cfdf5f8c-012a-4c0f-b740-e2cb65e61b75 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 1c099afc-d941-4044-83cc-39185d6d57b0] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:58.204609 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-cfdf5f8c-012a-4c0f-b740-e2cb65e61b75 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:58.205035 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-cfdf5f8c-012a-4c0f-b740-e2cb65e61b75 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:58.205879 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-cfdf5f8c-012a-4c0f-b740-e2cb65e61b75 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:58.206365 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-cfdf5f8c-012a-4c0f-b740-e2cb65e61b75 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:58.210126 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5bfac5a8-05a7-48ae-9350-2575c339e730 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:58.211635 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5bfac5a8-05a7-48ae-9350-2575c339e730 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:58.214060 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5bfac5a8-05a7-48ae-9350-2575c339e730 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:58.215618 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5bfac5a8-05a7-48ae-9350-2575c339e730 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:58.563481 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-cfdf5f8c-012a-4c0f-b740-e2cb65e61b75 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:58.572865 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-cfdf5f8c-012a-4c0f-b740-e2cb65e61b75 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0" status: 200 len: 1321 microversion: 2.1 time: 0.382159 Feb 17 04:36:58.573731 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 38/85] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:58 2021] GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0 => generated 1321 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:58.621628 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-5bfac5a8-05a7-48ae-9350-2575c339e730 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a46d18160148f3a48ef4887f6ec7da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6284f2b80524eb0a36ccebaedba767a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:58.632067 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-5bfac5a8-05a7-48ae-9350-2575c339e730 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "GET /compute/v2.1/servers/3ba4c3af-2d1e-4f4a-93e2-0e77d090962d" status: 200 len: 1317 microversion: 2.1 time: 0.442761 Feb 17 04:36:58.632860 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 48/86] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:58 2021] GET /compute/v2.1/servers/3ba4c3af-2d1e-4f4a-93e2-0e77d090962d => generated 1317 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:58.750614 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-406169f5-9b5e-4adf-b4f9-5f181ff0eb77 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:58.751285 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-406169f5-9b5e-4adf-b4f9-5f181ff0eb77 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:58.759729 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-406169f5-9b5e-4adf-b4f9-5f181ff0eb77 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:58.760244 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-406169f5-9b5e-4adf-b4f9-5f181ff0eb77 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:58.761090 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-406169f5-9b5e-4adf-b4f9-5f181ff0eb77 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:58.761583 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-406169f5-9b5e-4adf-b4f9-5f181ff0eb77 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:59.011238 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-406169f5-9b5e-4adf-b4f9-5f181ff0eb77 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:59.022436 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-406169f5-9b5e-4adf-b4f9-5f181ff0eb77 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:59.025933 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-406169f5-9b5e-4adf-b4f9-5f181ff0eb77 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:59.027327 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-406169f5-9b5e-4adf-b4f9-5f181ff0eb77 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1408 microversion: 2.20 time: 0.280821 Feb 17 04:36:59.027889 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 39/87] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:36:58 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1408 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:36:59.078339 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-bdf3869e-8844-493a-8940-9b6daf824df1 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:59.079035 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-bdf3869e-8844-493a-8940-9b6daf824df1 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] [instance: eef504a5-c89a-46d6-b032-3f78f265ed79] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:59.087664 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-bdf3869e-8844-493a-8940-9b6daf824df1 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:59.088620 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-bdf3869e-8844-493a-8940-9b6daf824df1 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:59.089471 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-bdf3869e-8844-493a-8940-9b6daf824df1 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:59.090081 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-bdf3869e-8844-493a-8940-9b6daf824df1 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:59.366637 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-bdf3869e-8844-493a-8940-9b6daf824df1 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b74b528e2d4778a5f82cba65fcc178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c8bf81d567949c194eb63efc45f5bdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:36:59.378071 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-bdf3869e-8844-493a-8940-9b6daf824df1 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] 10.222.0.38 "GET /compute/v2.1/servers/eef504a5-c89a-46d6-b032-3f78f265ed79" status: 200 len: 1314 microversion: 2.1 time: 0.304042 Feb 17 04:36:59.379628 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 49/88] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:59 2021] GET /compute/v2.1/servers/eef504a5-c89a-46d6-b032-3f78f265ed79 => generated 1314 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:36:59.509603 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [req-08c8d5f7-c5d7-4be8-84cc-f45d4feb47b8 req-62ec2acf-e275-4d6c-9d1c-ea58a98cf0a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eef504a5-c89a-46d6-b032-3f78f265ed79", "name": "network-vif-plugged", "status": "completed", "tag": "9be13024-0135-468a-a333-ad54ca5b0575"}]} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:36:59.511342 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:36:59.511342 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:36:59.520666 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-08c8d5f7-c5d7-4be8-84cc-f45d4feb47b8 req-62ec2acf-e275-4d6c-9d1c-ea58a98cf0a8 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:59.521967 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-08c8d5f7-c5d7-4be8-84cc-f45d4feb47b8 req-62ec2acf-e275-4d6c-9d1c-ea58a98cf0a8 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:59.570033 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.compute.server_external_events [req-08c8d5f7-c5d7-4be8-84cc-f45d4feb47b8 req-62ec2acf-e275-4d6c-9d1c-ea58a98cf0a8 service nova] Creating event network-vif-plugged:9be13024-0135-468a-a333-ad54ca5b0575 for instance eef504a5-c89a-46d6-b032-3f78f265ed79 on hv-cinder-76019 Feb 17 04:36:59.588008 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [req-08c8d5f7-c5d7-4be8-84cc-f45d4feb47b8 req-62ec2acf-e275-4d6c-9d1c-ea58a98cf0a8 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077025 Feb 17 04:36:59.589124 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 40/89] 10.222.0.38 () {64 vars in 1308 bytes} [Wed Feb 17 04:36:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:36:59.592253 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-c4875490-0b08-43a1-ae5b-35f907b1a778 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:59.593225 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-c4875490-0b08-43a1-ae5b-35f907b1a778 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 1c099afc-d941-4044-83cc-39185d6d57b0] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:59.611316 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c4875490-0b08-43a1-ae5b-35f907b1a778 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:59.611790 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c4875490-0b08-43a1-ae5b-35f907b1a778 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:59.626780 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c4875490-0b08-43a1-ae5b-35f907b1a778 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:59.627833 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c4875490-0b08-43a1-ae5b-35f907b1a778 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:59.652168 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-8e713e08-0975-4594-880d-6ae62c41e598 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:36:59.653130 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-8e713e08-0975-4594-880d-6ae62c41e598 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: 3ba4c3af-2d1e-4f4a-93e2-0e77d090962d] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:36:59.699031 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8e713e08-0975-4594-880d-6ae62c41e598 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:59.699584 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8e713e08-0975-4594-880d-6ae62c41e598 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:36:59.700475 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8e713e08-0975-4594-880d-6ae62c41e598 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:36:59.700957 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8e713e08-0975-4594-880d-6ae62c41e598 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:00.575034 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-8e713e08-0975-4594-880d-6ae62c41e598 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a46d18160148f3a48ef4887f6ec7da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6284f2b80524eb0a36ccebaedba767a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:00.591153 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-8e713e08-0975-4594-880d-6ae62c41e598 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "GET /compute/v2.1/servers/3ba4c3af-2d1e-4f4a-93e2-0e77d090962d" status: 200 len: 1317 microversion: 2.1 time: 0.945383 Feb 17 04:37:00.591775 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 41/90] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:59 2021] GET /compute/v2.1/servers/3ba4c3af-2d1e-4f4a-93e2-0e77d090962d => generated 1317 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:00.608090 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-e53aafdf-394b-4efa-994c-7a35b61d484f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:00.608767 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-e53aafdf-394b-4efa-994c-7a35b61d484f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:00.622909 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-c4875490-0b08-43a1-ae5b-35f907b1a778 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:00.626361 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e53aafdf-394b-4efa-994c-7a35b61d484f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:00.629096 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e53aafdf-394b-4efa-994c-7a35b61d484f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:00.630001 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e53aafdf-394b-4efa-994c-7a35b61d484f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:00.631057 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e53aafdf-394b-4efa-994c-7a35b61d484f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:00.635310 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-c4875490-0b08-43a1-ae5b-35f907b1a778 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0" status: 200 len: 1321 microversion: 2.1 time: 1.048322 Feb 17 04:37:00.636194 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 50/91] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:36:59 2021] GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0 => generated 1321 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:37:00.641759 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-e2ee26b3-53c4-4bc1-b6dd-a48fc2408962 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:00.642676 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-e2ee26b3-53c4-4bc1-b6dd-a48fc2408962 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] [instance: eef504a5-c89a-46d6-b032-3f78f265ed79] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:00.651828 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e2ee26b3-53c4-4bc1-b6dd-a48fc2408962 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:00.652624 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e2ee26b3-53c4-4bc1-b6dd-a48fc2408962 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:00.653690 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e2ee26b3-53c4-4bc1-b6dd-a48fc2408962 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:00.654929 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e2ee26b3-53c4-4bc1-b6dd-a48fc2408962 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:01.468003 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-e2ee26b3-53c4-4bc1-b6dd-a48fc2408962 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b74b528e2d4778a5f82cba65fcc178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c8bf81d567949c194eb63efc45f5bdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:01.477479 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-e2ee26b3-53c4-4bc1-b6dd-a48fc2408962 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] 10.222.0.38 "GET /compute/v2.1/servers/eef504a5-c89a-46d6-b032-3f78f265ed79" status: 200 len: 1314 microversion: 2.1 time: 0.839965 Feb 17 04:37:01.478225 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 51/92] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:00 2021] GET /compute/v2.1/servers/eef504a5-c89a-46d6-b032-3f78f265ed79 => generated 1314 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:01.483261 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [req-28b52cca-3e66-40fb-93ef-fd6ad215ccd0 req-09e6cd98-a0a6-4e01-8ccc-658be9265920 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c099afc-d941-4044-83cc-39185d6d57b0", "tag": "1dc54b74-4d8c-493a-918e-f2cbda4994d3"}]} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:37:01.485001 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:37:01.485001 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:37:01.492835 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-e53aafdf-394b-4efa-994c-7a35b61d484f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:01.495855 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-28b52cca-3e66-40fb-93ef-fd6ad215ccd0 req-09e6cd98-a0a6-4e01-8ccc-658be9265920 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:01.496438 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-28b52cca-3e66-40fb-93ef-fd6ad215ccd0 req-09e6cd98-a0a6-4e01-8ccc-658be9265920 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:01.503047 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-e53aafdf-394b-4efa-994c-7a35b61d484f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:01.504899 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-e53aafdf-394b-4efa-994c-7a35b61d484f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:01.506825 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-e53aafdf-394b-4efa-994c-7a35b61d484f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1408 microversion: 2.20 time: 0.903074 Feb 17 04:37:01.507558 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 42/93] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:37:00 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1408 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:37:01.517811 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.compute.server_external_events [req-28b52cca-3e66-40fb-93ef-fd6ad215ccd0 req-09e6cd98-a0a6-4e01-8ccc-658be9265920 service nova] Creating event network-changed:1dc54b74-4d8c-493a-918e-f2cbda4994d3 for instance 1c099afc-d941-4044-83cc-39185d6d57b0 on hv-cinder-76019 Feb 17 04:37:01.523108 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [req-28b52cca-3e66-40fb-93ef-fd6ad215ccd0 req-09e6cd98-a0a6-4e01-8ccc-658be9265920 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043350 Feb 17 04:37:01.524256 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 52/94] 10.222.0.38 () {64 vars in 1308 bytes} [Wed Feb 17 04:37:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:37:01.610926 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-68b9387c-616f-404e-902b-1dc295e39f2c tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:01.611592 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-68b9387c-616f-404e-902b-1dc295e39f2c tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: 3ba4c3af-2d1e-4f4a-93e2-0e77d090962d] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:01.620684 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-68b9387c-616f-404e-902b-1dc295e39f2c tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:01.621284 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-68b9387c-616f-404e-902b-1dc295e39f2c tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:01.622220 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-68b9387c-616f-404e-902b-1dc295e39f2c tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:01.622897 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-68b9387c-616f-404e-902b-1dc295e39f2c tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:01.654220 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-5457949c-18c5-4603-8e36-7614b98234e2 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:01.655320 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-5457949c-18c5-4603-8e36-7614b98234e2 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 1c099afc-d941-4044-83cc-39185d6d57b0] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:01.664961 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5457949c-18c5-4603-8e36-7614b98234e2 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:01.665732 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5457949c-18c5-4603-8e36-7614b98234e2 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:01.666759 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5457949c-18c5-4603-8e36-7614b98234e2 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:01.667390 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5457949c-18c5-4603-8e36-7614b98234e2 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:02.315952 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-68b9387c-616f-404e-902b-1dc295e39f2c tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a46d18160148f3a48ef4887f6ec7da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6284f2b80524eb0a36ccebaedba767a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:02.325764 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-68b9387c-616f-404e-902b-1dc295e39f2c tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "GET /compute/v2.1/servers/3ba4c3af-2d1e-4f4a-93e2-0e77d090962d" status: 200 len: 1317 microversion: 2.1 time: 0.719060 Feb 17 04:37:02.326317 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 43/95] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:01 2021] GET /compute/v2.1/servers/3ba4c3af-2d1e-4f4a-93e2-0e77d090962d => generated 1317 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:02.328163 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-5457949c-18c5-4603-8e36-7614b98234e2 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:02.331262 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [req-38bbab4f-13a9-4512-94e8-d82586c8c214 req-0599930e-08bf-4dba-bd36-9922290d1c22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d9c77fb-c4b1-4b48-a00a-b85af63c8920", "tag": "f8a409c8-c8d0-47e0-b35c-7b5830e57e6e"}]} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:37:02.338821 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:37:02.338821 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:37:02.339373 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-5457949c-18c5-4603-8e36-7614b98234e2 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0" status: 200 len: 1321 microversion: 2.1 time: 0.689600 Feb 17 04:37:02.349462 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 53/96] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:01 2021] GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0 => generated 1321 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:02.355718 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-38bbab4f-13a9-4512-94e8-d82586c8c214 req-0599930e-08bf-4dba-bd36-9922290d1c22 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:02.356216 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-38bbab4f-13a9-4512-94e8-d82586c8c214 req-0599930e-08bf-4dba-bd36-9922290d1c22 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:02.375066 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.compute.server_external_events [req-38bbab4f-13a9-4512-94e8-d82586c8c214 req-0599930e-08bf-4dba-bd36-9922290d1c22 service nova] Creating event network-changed:f8a409c8-c8d0-47e0-b35c-7b5830e57e6e for instance 8d9c77fb-c4b1-4b48-a00a-b85af63c8920 on hv-cinder-76019 Feb 17 04:37:02.381628 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [req-38bbab4f-13a9-4512-94e8-d82586c8c214 req-0599930e-08bf-4dba-bd36-9922290d1c22 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052576 Feb 17 04:37:02.382651 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 44/97] 10.222.0.38 () {64 vars in 1308 bytes} [Wed Feb 17 04:37:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:37:02.496343 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-282e8b89-8e40-41ff-922e-87a361cd6214 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:02.497018 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-282e8b89-8e40-41ff-922e-87a361cd6214 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] [instance: eef504a5-c89a-46d6-b032-3f78f265ed79] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:02.505124 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-282e8b89-8e40-41ff-922e-87a361cd6214 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:02.505767 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-282e8b89-8e40-41ff-922e-87a361cd6214 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:02.506618 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-282e8b89-8e40-41ff-922e-87a361cd6214 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:02.507116 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-282e8b89-8e40-41ff-922e-87a361cd6214 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:02.526825 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-1e151c41-9a6e-428f-818b-d466c6ac2821 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:02.528037 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-1e151c41-9a6e-428f-818b-d466c6ac2821 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:02.537086 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1e151c41-9a6e-428f-818b-d466c6ac2821 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:02.537696 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1e151c41-9a6e-428f-818b-d466c6ac2821 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:02.538687 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1e151c41-9a6e-428f-818b-d466c6ac2821 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:02.539275 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1e151c41-9a6e-428f-818b-d466c6ac2821 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:03.124309 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-282e8b89-8e40-41ff-922e-87a361cd6214 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b74b528e2d4778a5f82cba65fcc178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c8bf81d567949c194eb63efc45f5bdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:03.133859 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-282e8b89-8e40-41ff-922e-87a361cd6214 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] 10.222.0.38 "GET /compute/v2.1/servers/eef504a5-c89a-46d6-b032-3f78f265ed79" status: 200 len: 1314 microversion: 2.1 time: 0.641355 Feb 17 04:37:03.134392 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 54/98] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:02 2021] GET /compute/v2.1/servers/eef504a5-c89a-46d6-b032-3f78f265ed79 => generated 1314 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:03.152774 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-1e151c41-9a6e-428f-818b-d466c6ac2821 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:03.162289 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-1e151c41-9a6e-428f-818b-d466c6ac2821 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:03.163900 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-1e151c41-9a6e-428f-818b-d466c6ac2821 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:03.165030 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-1e151c41-9a6e-428f-818b-d466c6ac2821 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1408 microversion: 2.20 time: 0.642854 Feb 17 04:37:03.165623 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 45/99] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:37:02 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1408 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:37:03.347620 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-8beb1b3b-fb48-4c90-9d66-2f42375a0d27 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:03.348885 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-8beb1b3b-fb48-4c90-9d66-2f42375a0d27 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: 3ba4c3af-2d1e-4f4a-93e2-0e77d090962d] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:03.358365 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8beb1b3b-fb48-4c90-9d66-2f42375a0d27 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:03.359262 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8beb1b3b-fb48-4c90-9d66-2f42375a0d27 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:03.360515 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8beb1b3b-fb48-4c90-9d66-2f42375a0d27 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:03.361174 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8beb1b3b-fb48-4c90-9d66-2f42375a0d27 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:03.364066 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-70272c79-c4fe-4948-bdaf-79cb2dbe883d tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:03.365239 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-70272c79-c4fe-4948-bdaf-79cb2dbe883d tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 1c099afc-d941-4044-83cc-39185d6d57b0] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:03.377348 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-70272c79-c4fe-4948-bdaf-79cb2dbe883d tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:03.378428 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-70272c79-c4fe-4948-bdaf-79cb2dbe883d tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:03.379707 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-70272c79-c4fe-4948-bdaf-79cb2dbe883d tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:03.380409 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-70272c79-c4fe-4948-bdaf-79cb2dbe883d tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:03.983257 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-8beb1b3b-fb48-4c90-9d66-2f42375a0d27 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a46d18160148f3a48ef4887f6ec7da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6284f2b80524eb0a36ccebaedba767a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:03.993552 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-8beb1b3b-fb48-4c90-9d66-2f42375a0d27 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "GET /compute/v2.1/servers/3ba4c3af-2d1e-4f4a-93e2-0e77d090962d" status: 200 len: 1317 microversion: 2.1 time: 0.652745 Feb 17 04:37:03.994386 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 55/100] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:03 2021] GET /compute/v2.1/servers/3ba4c3af-2d1e-4f4a-93e2-0e77d090962d => generated 1317 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:04.002504 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-70272c79-c4fe-4948-bdaf-79cb2dbe883d tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:04.012316 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-70272c79-c4fe-4948-bdaf-79cb2dbe883d tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0" status: 200 len: 1321 microversion: 2.1 time: 0.658034 Feb 17 04:37:04.013129 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 46/101] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:03 2021] GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0 => generated 1321 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:04.152780 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-d137f27f-acbf-4a0c-9bfd-ce952df1bcdd tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:04.153462 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-d137f27f-acbf-4a0c-9bfd-ce952df1bcdd tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] [instance: eef504a5-c89a-46d6-b032-3f78f265ed79] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:04.172667 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d137f27f-acbf-4a0c-9bfd-ce952df1bcdd tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:04.173178 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d137f27f-acbf-4a0c-9bfd-ce952df1bcdd tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:04.174038 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d137f27f-acbf-4a0c-9bfd-ce952df1bcdd tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:04.174530 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d137f27f-acbf-4a0c-9bfd-ce952df1bcdd tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:04.188457 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-793552db-8b88-4351-afc7-45be804f8129 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:04.189132 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-793552db-8b88-4351-afc7-45be804f8129 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:04.207809 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-793552db-8b88-4351-afc7-45be804f8129 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:04.208324 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-793552db-8b88-4351-afc7-45be804f8129 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:04.209199 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-793552db-8b88-4351-afc7-45be804f8129 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:04.210218 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-793552db-8b88-4351-afc7-45be804f8129 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:04.828313 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-d137f27f-acbf-4a0c-9bfd-ce952df1bcdd tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b74b528e2d4778a5f82cba65fcc178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c8bf81d567949c194eb63efc45f5bdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:04.836456 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-793552db-8b88-4351-afc7-45be804f8129 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:04.840060 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-d137f27f-acbf-4a0c-9bfd-ce952df1bcdd tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] 10.222.0.38 "GET /compute/v2.1/servers/eef504a5-c89a-46d6-b032-3f78f265ed79" status: 200 len: 1314 microversion: 2.1 time: 0.691515 Feb 17 04:37:04.840762 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 56/102] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:04 2021] GET /compute/v2.1/servers/eef504a5-c89a-46d6-b032-3f78f265ed79 => generated 1314 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:04.846347 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-793552db-8b88-4351-afc7-45be804f8129 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:04.847303 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-793552db-8b88-4351-afc7-45be804f8129 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:04.848482 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-793552db-8b88-4351-afc7-45be804f8129 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1408 microversion: 2.20 time: 0.667692 Feb 17 04:37:04.849161 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 47/103] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:37:04 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1408 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:37:05.012171 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-c2dfd199-61b5-43f9-8331-c6d2e1ea21f5 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:05.013352 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-c2dfd199-61b5-43f9-8331-c6d2e1ea21f5 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: 3ba4c3af-2d1e-4f4a-93e2-0e77d090962d] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:05.021367 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c2dfd199-61b5-43f9-8331-c6d2e1ea21f5 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:05.021869 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c2dfd199-61b5-43f9-8331-c6d2e1ea21f5 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:05.023581 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c2dfd199-61b5-43f9-8331-c6d2e1ea21f5 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:05.023916 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c2dfd199-61b5-43f9-8331-c6d2e1ea21f5 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:05.029886 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-cb2a0e2b-10e1-4ba5-8fe7-71b5f4f81082 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:05.030899 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-cb2a0e2b-10e1-4ba5-8fe7-71b5f4f81082 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 1c099afc-d941-4044-83cc-39185d6d57b0] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:05.042539 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-cb2a0e2b-10e1-4ba5-8fe7-71b5f4f81082 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:05.043259 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-cb2a0e2b-10e1-4ba5-8fe7-71b5f4f81082 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:05.044137 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-cb2a0e2b-10e1-4ba5-8fe7-71b5f4f81082 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:05.044613 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-cb2a0e2b-10e1-4ba5-8fe7-71b5f4f81082 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:05.356050 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-c2dfd199-61b5-43f9-8331-c6d2e1ea21f5 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a46d18160148f3a48ef4887f6ec7da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6284f2b80524eb0a36ccebaedba767a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:05.358704 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-cb2a0e2b-10e1-4ba5-8fe7-71b5f4f81082 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:05.365198 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-c2dfd199-61b5-43f9-8331-c6d2e1ea21f5 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "GET /compute/v2.1/servers/3ba4c3af-2d1e-4f4a-93e2-0e77d090962d" status: 200 len: 1317 microversion: 2.1 time: 0.356968 Feb 17 04:37:05.365802 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 57/104] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:05 2021] GET /compute/v2.1/servers/3ba4c3af-2d1e-4f4a-93e2-0e77d090962d => generated 1317 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:05.367634 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-cb2a0e2b-10e1-4ba5-8fe7-71b5f4f81082 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0" status: 200 len: 1321 microversion: 2.1 time: 0.342035 Feb 17 04:37:05.368231 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 48/105] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:05 2021] GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0 => generated 1321 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:05.857970 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-a1d1ff2a-5946-41e4-bb7d-0f6f71f8b881 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:05.858659 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-a1d1ff2a-5946-41e4-bb7d-0f6f71f8b881 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] [instance: eef504a5-c89a-46d6-b032-3f78f265ed79] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:05.867700 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a1d1ff2a-5946-41e4-bb7d-0f6f71f8b881 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:05.868210 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a1d1ff2a-5946-41e4-bb7d-0f6f71f8b881 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:05.869052 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a1d1ff2a-5946-41e4-bb7d-0f6f71f8b881 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:05.869546 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a1d1ff2a-5946-41e4-bb7d-0f6f71f8b881 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:05.870152 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-edc27eb8-68fd-4edc-b859-5b4850e0cc16 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:05.870841 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-edc27eb8-68fd-4edc-b859-5b4850e0cc16 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:05.879111 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-edc27eb8-68fd-4edc-b859-5b4850e0cc16 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:05.879613 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-edc27eb8-68fd-4edc-b859-5b4850e0cc16 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:05.880448 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-edc27eb8-68fd-4edc-b859-5b4850e0cc16 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:05.880937 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-edc27eb8-68fd-4edc-b859-5b4850e0cc16 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:06.219446 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-a1d1ff2a-5946-41e4-bb7d-0f6f71f8b881 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b74b528e2d4778a5f82cba65fcc178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c8bf81d567949c194eb63efc45f5bdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:06.223765 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-edc27eb8-68fd-4edc-b859-5b4850e0cc16 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:06.229457 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-a1d1ff2a-5946-41e4-bb7d-0f6f71f8b881 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] 10.222.0.38 "GET /compute/v2.1/servers/eef504a5-c89a-46d6-b032-3f78f265ed79" status: 200 len: 1314 microversion: 2.1 time: 0.375456 Feb 17 04:37:06.230066 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 58/106] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:05 2021] GET /compute/v2.1/servers/eef504a5-c89a-46d6-b032-3f78f265ed79 => generated 1314 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:06.233580 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-edc27eb8-68fd-4edc-b859-5b4850e0cc16 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:06.235174 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-edc27eb8-68fd-4edc-b859-5b4850e0cc16 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:06.236292 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-edc27eb8-68fd-4edc-b859-5b4850e0cc16 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1408 microversion: 2.20 time: 0.371429 Feb 17 04:37:06.236861 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 49/107] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:37:05 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1408 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 04:37:06.383853 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-b943e2d9-9567-47ba-ae8c-f84251189d20 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:06.384526 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-b943e2d9-9567-47ba-ae8c-f84251189d20 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: 3ba4c3af-2d1e-4f4a-93e2-0e77d090962d] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:06.385527 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-612c22dd-8fe3-4510-8f61-bc538e33c69c tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:06.386219 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-612c22dd-8fe3-4510-8f61-bc538e33c69c tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 1c099afc-d941-4044-83cc-39185d6d57b0] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:06.393371 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b943e2d9-9567-47ba-ae8c-f84251189d20 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:06.393888 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b943e2d9-9567-47ba-ae8c-f84251189d20 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:06.394330 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-612c22dd-8fe3-4510-8f61-bc538e33c69c tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:06.394774 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b943e2d9-9567-47ba-ae8c-f84251189d20 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:06.394908 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-612c22dd-8fe3-4510-8f61-bc538e33c69c tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:06.395278 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b943e2d9-9567-47ba-ae8c-f84251189d20 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:06.395684 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-612c22dd-8fe3-4510-8f61-bc538e33c69c tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:06.396172 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-612c22dd-8fe3-4510-8f61-bc538e33c69c tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:06.719169 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-612c22dd-8fe3-4510-8f61-bc538e33c69c tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:06.727806 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-b943e2d9-9567-47ba-ae8c-f84251189d20 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a46d18160148f3a48ef4887f6ec7da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6284f2b80524eb0a36ccebaedba767a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:06.729031 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-612c22dd-8fe3-4510-8f61-bc538e33c69c tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0" status: 200 len: 1321 microversion: 2.1 time: 0.347719 Feb 17 04:37:06.729828 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 50/108] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:06 2021] GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0 => generated 1321 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:06.737721 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-b943e2d9-9567-47ba-ae8c-f84251189d20 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "GET /compute/v2.1/servers/3ba4c3af-2d1e-4f4a-93e2-0e77d090962d" status: 200 len: 1317 microversion: 2.1 time: 0.357805 Feb 17 04:37:06.738477 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 59/109] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:06 2021] GET /compute/v2.1/servers/3ba4c3af-2d1e-4f4a-93e2-0e77d090962d => generated 1317 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:07.247348 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-59495fa3-c985-4dfa-859a-0cdd9199f616 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:07.247944 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-59495fa3-c985-4dfa-859a-0cdd9199f616 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] [instance: eef504a5-c89a-46d6-b032-3f78f265ed79] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:07.255393 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-8d298f9e-2ef6-4846-9640-661a2dcdb337 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:07.255745 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-59495fa3-c985-4dfa-859a-0cdd9199f616 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:07.256066 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-8d298f9e-2ef6-4846-9640-661a2dcdb337 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:07.256248 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-59495fa3-c985-4dfa-859a-0cdd9199f616 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:07.257112 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-59495fa3-c985-4dfa-859a-0cdd9199f616 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:07.257593 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-59495fa3-c985-4dfa-859a-0cdd9199f616 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:07.264743 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8d298f9e-2ef6-4846-9640-661a2dcdb337 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:07.265252 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8d298f9e-2ef6-4846-9640-661a2dcdb337 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:07.266096 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8d298f9e-2ef6-4846-9640-661a2dcdb337 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:07.266602 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8d298f9e-2ef6-4846-9640-661a2dcdb337 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:07.721516 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-59495fa3-c985-4dfa-859a-0cdd9199f616 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b74b528e2d4778a5f82cba65fcc178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c8bf81d567949c194eb63efc45f5bdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:07.728521 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-8d298f9e-2ef6-4846-9640-661a2dcdb337 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:07.730884 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-59495fa3-c985-4dfa-859a-0cdd9199f616 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] 10.222.0.38 "GET /compute/v2.1/servers/eef504a5-c89a-46d6-b032-3f78f265ed79" status: 200 len: 1314 microversion: 2.1 time: 0.487402 Feb 17 04:37:07.731820 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 51/110] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:07 2021] GET /compute/v2.1/servers/eef504a5-c89a-46d6-b032-3f78f265ed79 => generated 1314 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:07.739088 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-8d298f9e-2ef6-4846-9640-661a2dcdb337 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:07.741923 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-8d298f9e-2ef6-4846-9640-661a2dcdb337 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:07.742644 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-8d298f9e-2ef6-4846-9640-661a2dcdb337 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1408 microversion: 2.20 time: 0.491250 Feb 17 04:37:07.743294 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 60/111] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:37:07 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1408 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 04:37:07.747583 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-8ecef24e-5058-4e03-abeb-c4ad5b4e7962 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:07.748252 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-8ecef24e-5058-4e03-abeb-c4ad5b4e7962 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 1c099afc-d941-4044-83cc-39185d6d57b0] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:07.756281 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8ecef24e-5058-4e03-abeb-c4ad5b4e7962 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:07.756739 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8ecef24e-5058-4e03-abeb-c4ad5b4e7962 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:07.757687 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8ecef24e-5058-4e03-abeb-c4ad5b4e7962 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:07.758182 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8ecef24e-5058-4e03-abeb-c4ad5b4e7962 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:07.760024 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-f2324307-db1a-4b38-910a-cab6c551d8af tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:07.760683 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-f2324307-db1a-4b38-910a-cab6c551d8af tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: 3ba4c3af-2d1e-4f4a-93e2-0e77d090962d] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:07.770331 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f2324307-db1a-4b38-910a-cab6c551d8af tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:07.770871 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f2324307-db1a-4b38-910a-cab6c551d8af tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:07.771728 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f2324307-db1a-4b38-910a-cab6c551d8af tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:07.772225 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f2324307-db1a-4b38-910a-cab6c551d8af tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:08.166586 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-8ecef24e-5058-4e03-abeb-c4ad5b4e7962 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:08.175538 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-8ecef24e-5058-4e03-abeb-c4ad5b4e7962 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0" status: 200 len: 1321 microversion: 2.1 time: 0.431761 Feb 17 04:37:08.176315 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 52/112] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:07 2021] GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0 => generated 1321 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:37:08.179094 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-f2324307-db1a-4b38-910a-cab6c551d8af tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a46d18160148f3a48ef4887f6ec7da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6284f2b80524eb0a36ccebaedba767a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:08.193130 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-f2324307-db1a-4b38-910a-cab6c551d8af tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "GET /compute/v2.1/servers/3ba4c3af-2d1e-4f4a-93e2-0e77d090962d" status: 200 len: 1317 microversion: 2.1 time: 0.437446 Feb 17 04:37:08.193895 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 61/113] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:07 2021] GET /compute/v2.1/servers/3ba4c3af-2d1e-4f4a-93e2-0e77d090962d => generated 1317 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:08.749585 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-a67953fa-c792-4b47-9538-c76483163052 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:08.750255 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-a67953fa-c792-4b47-9538-c76483163052 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] [instance: eef504a5-c89a-46d6-b032-3f78f265ed79] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:08.758419 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a67953fa-c792-4b47-9538-c76483163052 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:08.758960 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a67953fa-c792-4b47-9538-c76483163052 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:08.759804 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a67953fa-c792-4b47-9538-c76483163052 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:08.760296 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a67953fa-c792-4b47-9538-c76483163052 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:08.761262 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-c056c552-60f0-47ca-a7c4-4e185275feaa tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:08.761922 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-c056c552-60f0-47ca-a7c4-4e185275feaa tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:08.769689 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c056c552-60f0-47ca-a7c4-4e185275feaa tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:08.770183 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c056c552-60f0-47ca-a7c4-4e185275feaa tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:08.771057 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c056c552-60f0-47ca-a7c4-4e185275feaa tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:08.771544 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c056c552-60f0-47ca-a7c4-4e185275feaa tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:09.085675 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-a67953fa-c792-4b47-9538-c76483163052 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b74b528e2d4778a5f82cba65fcc178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c8bf81d567949c194eb63efc45f5bdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:09.094906 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-a67953fa-c792-4b47-9538-c76483163052 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] 10.222.0.38 "GET /compute/v2.1/servers/eef504a5-c89a-46d6-b032-3f78f265ed79" status: 200 len: 1314 microversion: 2.1 time: 0.349283 Feb 17 04:37:09.095538 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 53/114] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:08 2021] GET /compute/v2.1/servers/eef504a5-c89a-46d6-b032-3f78f265ed79 => generated 1314 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:09.095971 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-c056c552-60f0-47ca-a7c4-4e185275feaa tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:09.107899 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-c056c552-60f0-47ca-a7c4-4e185275feaa tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:09.110109 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-c056c552-60f0-47ca-a7c4-4e185275feaa tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:09.111722 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-c056c552-60f0-47ca-a7c4-4e185275feaa tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1408 microversion: 2.20 time: 0.354158 Feb 17 04:37:09.112465 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 62/115] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:37:08 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1408 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:37:09.193741 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-28e86276-0c01-4f53-bd57-f44c6a3d25da tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:09.195043 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-28e86276-0c01-4f53-bd57-f44c6a3d25da tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 1c099afc-d941-4044-83cc-39185d6d57b0] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:09.203044 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-28e86276-0c01-4f53-bd57-f44c6a3d25da tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:09.203546 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-28e86276-0c01-4f53-bd57-f44c6a3d25da tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:09.204377 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-28e86276-0c01-4f53-bd57-f44c6a3d25da tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:09.204867 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-28e86276-0c01-4f53-bd57-f44c6a3d25da tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:09.213084 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-8d3f3ae0-6514-46fe-b62f-6d81a4875144 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:09.213760 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-8d3f3ae0-6514-46fe-b62f-6d81a4875144 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: 3ba4c3af-2d1e-4f4a-93e2-0e77d090962d] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:09.221627 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8d3f3ae0-6514-46fe-b62f-6d81a4875144 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:09.222140 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8d3f3ae0-6514-46fe-b62f-6d81a4875144 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:09.223027 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8d3f3ae0-6514-46fe-b62f-6d81a4875144 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:09.223530 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8d3f3ae0-6514-46fe-b62f-6d81a4875144 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:09.549564 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-28e86276-0c01-4f53-bd57-f44c6a3d25da tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:09.554205 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-8d3f3ae0-6514-46fe-b62f-6d81a4875144 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a46d18160148f3a48ef4887f6ec7da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6284f2b80524eb0a36ccebaedba767a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:09.559776 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-28e86276-0c01-4f53-bd57-f44c6a3d25da tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0" status: 200 len: 1321 microversion: 2.1 time: 0.370086 Feb 17 04:37:09.560507 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 54/116] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:09 2021] GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0 => generated 1321 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:09.565345 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-8d3f3ae0-6514-46fe-b62f-6d81a4875144 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "GET /compute/v2.1/servers/3ba4c3af-2d1e-4f4a-93e2-0e77d090962d" status: 200 len: 1317 microversion: 2.1 time: 0.357209 Feb 17 04:37:09.574607 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 63/117] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:09 2021] GET /compute/v2.1/servers/3ba4c3af-2d1e-4f4a-93e2-0e77d090962d => generated 1317 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:10.114014 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-6b97dc3e-78d0-4009-8edb-319578f68199 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:10.114715 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-6b97dc3e-78d0-4009-8edb-319578f68199 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] [instance: eef504a5-c89a-46d6-b032-3f78f265ed79] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:10.125583 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6b97dc3e-78d0-4009-8edb-319578f68199 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:10.126424 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6b97dc3e-78d0-4009-8edb-319578f68199 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:10.128358 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6b97dc3e-78d0-4009-8edb-319578f68199 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:10.129516 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6b97dc3e-78d0-4009-8edb-319578f68199 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:10.132510 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-c6102775-f8a6-4e45-9941-f208c76c602a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:10.133185 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-c6102775-f8a6-4e45-9941-f208c76c602a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:10.141425 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c6102775-f8a6-4e45-9941-f208c76c602a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:10.141993 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c6102775-f8a6-4e45-9941-f208c76c602a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:10.143126 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c6102775-f8a6-4e45-9941-f208c76c602a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:10.143700 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c6102775-f8a6-4e45-9941-f208c76c602a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:10.485359 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-c6102775-f8a6-4e45-9941-f208c76c602a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:10.489616 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-6b97dc3e-78d0-4009-8edb-319578f68199 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b74b528e2d4778a5f82cba65fcc178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c8bf81d567949c194eb63efc45f5bdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:10.496147 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-c6102775-f8a6-4e45-9941-f208c76c602a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:10.497763 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-c6102775-f8a6-4e45-9941-f208c76c602a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:10.498915 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-c6102775-f8a6-4e45-9941-f208c76c602a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1408 microversion: 2.20 time: 0.370681 Feb 17 04:37:10.499325 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-6b97dc3e-78d0-4009-8edb-319578f68199 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] 10.222.0.38 "GET /compute/v2.1/servers/eef504a5-c89a-46d6-b032-3f78f265ed79" status: 200 len: 1501 microversion: 2.1 time: 0.389262 Feb 17 04:37:10.499488 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 64/118] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:37:10 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1408 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 04:37:10.499917 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 55/119] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:10 2021] GET /compute/v2.1/servers/eef504a5-c89a-46d6-b032-3f78f265ed79 => generated 1501 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:10.578680 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-98747c66-a76c-4013-b50f-2975f456dcce tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:10.579635 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-98747c66-a76c-4013-b50f-2975f456dcce tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 1c099afc-d941-4044-83cc-39185d6d57b0] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:10.586284 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-c947f002-8402-494d-b958-f250057afa1b tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:10.587308 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-c947f002-8402-494d-b958-f250057afa1b tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: 3ba4c3af-2d1e-4f4a-93e2-0e77d090962d] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:10.588410 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-98747c66-a76c-4013-b50f-2975f456dcce tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:10.588927 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-98747c66-a76c-4013-b50f-2975f456dcce tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:10.589987 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-98747c66-a76c-4013-b50f-2975f456dcce tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:10.590701 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-98747c66-a76c-4013-b50f-2975f456dcce tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:10.595872 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c947f002-8402-494d-b958-f250057afa1b tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:10.596833 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c947f002-8402-494d-b958-f250057afa1b tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:10.597683 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c947f002-8402-494d-b958-f250057afa1b tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:10.598313 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c947f002-8402-494d-b958-f250057afa1b tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:10.933053 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-c947f002-8402-494d-b958-f250057afa1b tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a46d18160148f3a48ef4887f6ec7da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6284f2b80524eb0a36ccebaedba767a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:10.936298 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-98747c66-a76c-4013-b50f-2975f456dcce tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:10.944705 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-c947f002-8402-494d-b958-f250057afa1b tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "GET /compute/v2.1/servers/3ba4c3af-2d1e-4f4a-93e2-0e77d090962d" status: 200 len: 1317 microversion: 2.1 time: 0.362395 Feb 17 04:37:10.945355 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 56/120] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:10 2021] GET /compute/v2.1/servers/3ba4c3af-2d1e-4f4a-93e2-0e77d090962d => generated 1317 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:10.945928 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-98747c66-a76c-4013-b50f-2975f456dcce tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0" status: 200 len: 1321 microversion: 2.1 time: 0.371733 Feb 17 04:37:10.946506 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 65/121] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:10 2021] GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0 => generated 1321 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:11.518901 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-50d27199-da5f-4deb-ab1a-d7d7da6b18bc tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:11.519668 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-50d27199-da5f-4deb-ab1a-d7d7da6b18bc tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:11.528267 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-50d27199-da5f-4deb-ab1a-d7d7da6b18bc tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:11.528780 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-50d27199-da5f-4deb-ab1a-d7d7da6b18bc tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:11.529635 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-50d27199-da5f-4deb-ab1a-d7d7da6b18bc tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:11.530137 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-50d27199-da5f-4deb-ab1a-d7d7da6b18bc tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:11.745996 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-50d27199-da5f-4deb-ab1a-d7d7da6b18bc tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:11.756118 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-50d27199-da5f-4deb-ab1a-d7d7da6b18bc tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:11.758519 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-50d27199-da5f-4deb-ab1a-d7d7da6b18bc tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:11.759674 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-50d27199-da5f-4deb-ab1a-d7d7da6b18bc tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1408 microversion: 2.20 time: 0.244887 Feb 17 04:37:11.760255 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 57/122] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:37:11 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1408 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:37:11.962004 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-e494efeb-3964-4352-9325-1fba40724c2f tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:11.962615 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-e494efeb-3964-4352-9325-1fba40724c2f tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: 3ba4c3af-2d1e-4f4a-93e2-0e77d090962d] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:11.970661 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e494efeb-3964-4352-9325-1fba40724c2f tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:11.971173 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e494efeb-3964-4352-9325-1fba40724c2f tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:11.972013 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e494efeb-3964-4352-9325-1fba40724c2f tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:11.972115 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-523a8386-986f-4f3d-85ac-0ed8be17018d tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:11.972508 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e494efeb-3964-4352-9325-1fba40724c2f tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:11.972702 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-523a8386-986f-4f3d-85ac-0ed8be17018d tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 1c099afc-d941-4044-83cc-39185d6d57b0] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:11.980522 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-523a8386-986f-4f3d-85ac-0ed8be17018d tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:11.981038 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-523a8386-986f-4f3d-85ac-0ed8be17018d tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:11.981866 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-523a8386-986f-4f3d-85ac-0ed8be17018d tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:11.982365 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-523a8386-986f-4f3d-85ac-0ed8be17018d tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:12.312964 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-e494efeb-3964-4352-9325-1fba40724c2f tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a46d18160148f3a48ef4887f6ec7da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6284f2b80524eb0a36ccebaedba767a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:12.320227 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-523a8386-986f-4f3d-85ac-0ed8be17018d tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:12.321986 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-e494efeb-3964-4352-9325-1fba40724c2f tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "GET /compute/v2.1/servers/3ba4c3af-2d1e-4f4a-93e2-0e77d090962d" status: 200 len: 1508 microversion: 2.1 time: 0.364426 Feb 17 04:37:12.322615 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 66/123] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:11 2021] GET /compute/v2.1/servers/3ba4c3af-2d1e-4f4a-93e2-0e77d090962d => generated 1508 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:12.329185 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-523a8386-986f-4f3d-85ac-0ed8be17018d tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0" status: 200 len: 1321 microversion: 2.1 time: 0.361041 Feb 17 04:37:12.329774 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 58/124] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:11 2021] GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0 => generated 1321 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:37:12.779238 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-eec8c633-fd74-4f2a-941a-da82d2d7cd0b tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:12.780056 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-eec8c633-fd74-4f2a-941a-da82d2d7cd0b tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:12.788063 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-eec8c633-fd74-4f2a-941a-da82d2d7cd0b tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:12.788648 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-eec8c633-fd74-4f2a-941a-da82d2d7cd0b tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:12.789475 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-eec8c633-fd74-4f2a-941a-da82d2d7cd0b tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:12.791889 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-eec8c633-fd74-4f2a-941a-da82d2d7cd0b tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:13.017767 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-eec8c633-fd74-4f2a-941a-da82d2d7cd0b tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:13.028151 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-eec8c633-fd74-4f2a-941a-da82d2d7cd0b tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:13.029624 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-eec8c633-fd74-4f2a-941a-da82d2d7cd0b tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:13.030768 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-eec8c633-fd74-4f2a-941a-da82d2d7cd0b tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1408 microversion: 2.20 time: 0.255799 Feb 17 04:37:13.031352 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 67/125] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:37:12 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1408 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:37:13.232697 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-ad5c932c-6e5a-4236-b154-c74b57b34871 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e2491bff-2d30-4dcf-a6d5-6122f7ad4ab5"}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:37:13.234227 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-ad5c932c-6e5a-4236-b154-c74b57b34871 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] [instance: eef504a5-c89a-46d6-b032-3f78f265ed79] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:13.244249 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ad5c932c-6e5a-4236-b154-c74b57b34871 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:13.244821 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ad5c932c-6e5a-4236-b154-c74b57b34871 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:13.245664 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ad5c932c-6e5a-4236-b154-c74b57b34871 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:13.246276 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ad5c932c-6e5a-4236-b154-c74b57b34871 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:13.347002 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-9654db03-621e-4323-8ec6-cdb87a5221a5 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:13.347808 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-9654db03-621e-4323-8ec6-cdb87a5221a5 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 1c099afc-d941-4044-83cc-39185d6d57b0] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:13.355957 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9654db03-621e-4323-8ec6-cdb87a5221a5 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:13.356704 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9654db03-621e-4323-8ec6-cdb87a5221a5 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:13.357554 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9654db03-621e-4323-8ec6-cdb87a5221a5 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:13.358219 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9654db03-621e-4323-8ec6-cdb87a5221a5 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:13.592924 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-9654db03-621e-4323-8ec6-cdb87a5221a5 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:13.602857 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-9654db03-621e-4323-8ec6-cdb87a5221a5 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0" status: 200 len: 1321 microversion: 2.1 time: 0.259683 Feb 17 04:37:13.603637 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 68/126] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:13 2021] GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0 => generated 1321 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:13.693132 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-ad5c932c-6e5a-4236-b154-c74b57b34871 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] 10.222.0.38 "POST /compute/v2.1/servers/eef504a5-c89a-46d6-b032-3f78f265ed79/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.464879 Feb 17 04:37:13.695078 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 59/127] 10.222.0.38 () {60 vars in 1313 bytes} [Wed Feb 17 04:37:13 2021] POST /compute/v2.1/servers/eef504a5-c89a-46d6-b032-3f78f265ed79/os-volume_attachments => generated 194 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:37:14.051051 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-32fb9863-5220-45d4-a77d-52b298170775 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:14.052411 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-32fb9863-5220-45d4-a77d-52b298170775 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:14.062024 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-32fb9863-5220-45d4-a77d-52b298170775 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:14.062962 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-32fb9863-5220-45d4-a77d-52b298170775 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:14.064863 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-32fb9863-5220-45d4-a77d-52b298170775 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:14.065563 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-32fb9863-5220-45d4-a77d-52b298170775 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:14.119919 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-d757f3cc-d68b-49ee-b552-f76331c347d9 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a7265231-7982-4176-bea7-6c35eb2163ee"}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:37:14.121540 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-d757f3cc-d68b-49ee-b552-f76331c347d9 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: 3ba4c3af-2d1e-4f4a-93e2-0e77d090962d] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:14.131888 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d757f3cc-d68b-49ee-b552-f76331c347d9 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:14.132722 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d757f3cc-d68b-49ee-b552-f76331c347d9 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:14.133985 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d757f3cc-d68b-49ee-b552-f76331c347d9 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:14.134740 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d757f3cc-d68b-49ee-b552-f76331c347d9 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:14.317677 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-32fb9863-5220-45d4-a77d-52b298170775 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:14.328391 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-32fb9863-5220-45d4-a77d-52b298170775 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:14.330069 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-32fb9863-5220-45d4-a77d-52b298170775 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:14.331355 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-32fb9863-5220-45d4-a77d-52b298170775 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1408 microversion: 2.20 time: 0.284370 Feb 17 04:37:14.332030 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 69/128] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:37:14 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1408 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:37:14.621986 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-c5a6441a-c6ce-4e0a-9fb8-d60ca213faf7 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:14.622596 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-c5a6441a-c6ce-4e0a-9fb8-d60ca213faf7 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 1c099afc-d941-4044-83cc-39185d6d57b0] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:14.630670 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c5a6441a-c6ce-4e0a-9fb8-d60ca213faf7 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:14.631185 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c5a6441a-c6ce-4e0a-9fb8-d60ca213faf7 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:14.632548 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c5a6441a-c6ce-4e0a-9fb8-d60ca213faf7 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:14.633045 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c5a6441a-c6ce-4e0a-9fb8-d60ca213faf7 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:14.816793 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-d757f3cc-d68b-49ee-b552-f76331c347d9 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "POST /compute/v2.1/servers/3ba4c3af-2d1e-4f4a-93e2-0e77d090962d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.702569 Feb 17 04:37:14.818774 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 60/129] 10.222.0.38 () {60 vars in 1313 bytes} [Wed Feb 17 04:37:14 2021] POST /compute/v2.1/servers/3ba4c3af-2d1e-4f4a-93e2-0e77d090962d/os-volume_attachments => generated 194 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:37:15.099583 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-c5a6441a-c6ce-4e0a-9fb8-d60ca213faf7 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:15.115001 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-c5a6441a-c6ce-4e0a-9fb8-d60ca213faf7 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0" status: 200 len: 1321 microversion: 2.1 time: 0.496450 Feb 17 04:37:15.116971 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 70/130] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:14 2021] GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0 => generated 1321 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:37:15.352769 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-9bbac71a-88d7-4435-b50b-103f41695430 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:15.353649 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-9bbac71a-88d7-4435-b50b-103f41695430 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:15.365187 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9bbac71a-88d7-4435-b50b-103f41695430 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:15.366854 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9bbac71a-88d7-4435-b50b-103f41695430 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:15.367811 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9bbac71a-88d7-4435-b50b-103f41695430 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:15.368368 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9bbac71a-88d7-4435-b50b-103f41695430 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:15.649789 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-9bbac71a-88d7-4435-b50b-103f41695430 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:15.669182 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-9bbac71a-88d7-4435-b50b-103f41695430 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:15.670781 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-9bbac71a-88d7-4435-b50b-103f41695430 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:15.681228 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-9bbac71a-88d7-4435-b50b-103f41695430 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1408 microversion: 2.20 time: 0.324576 Feb 17 04:37:15.681926 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 61/131] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:37:15 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1408 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:37:15.942759 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [req-40d603f1-2fd7-44e4-819e-75679806a6fb req-991ebe0d-0734-46c3-b116-33e0df644667 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68a5c561-c418-4a68-b8b3-1600b638b80c", "name": "network-vif-plugged", "status": "completed", "tag": "931d3091-bc84-4f99-9fec-11c4d1500c28"}]} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:37:15.945932 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:37:15.945932 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:37:15.956475 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-40d603f1-2fd7-44e4-819e-75679806a6fb req-991ebe0d-0734-46c3-b116-33e0df644667 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:15.957377 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-40d603f1-2fd7-44e4-819e-75679806a6fb req-991ebe0d-0734-46c3-b116-33e0df644667 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:15.983537 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.compute.server_external_events [req-40d603f1-2fd7-44e4-819e-75679806a6fb req-991ebe0d-0734-46c3-b116-33e0df644667 service nova] Creating event network-vif-plugged:931d3091-bc84-4f99-9fec-11c4d1500c28 for instance 68a5c561-c418-4a68-b8b3-1600b638b80c on hv-cinder-76019 Feb 17 04:37:15.991350 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [req-40d603f1-2fd7-44e4-819e-75679806a6fb req-991ebe0d-0734-46c3-b116-33e0df644667 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054432 Feb 17 04:37:15.992340 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 71/132] 10.222.0.38 () {64 vars in 1308 bytes} [Wed Feb 17 04:37:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:37:16.135122 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-07f0997f-9603-44b3-92f4-ce64afaae4b4 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:16.136512 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-07f0997f-9603-44b3-92f4-ce64afaae4b4 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 1c099afc-d941-4044-83cc-39185d6d57b0] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:16.146600 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-07f0997f-9603-44b3-92f4-ce64afaae4b4 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:16.147158 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-07f0997f-9603-44b3-92f4-ce64afaae4b4 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:16.148142 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-07f0997f-9603-44b3-92f4-ce64afaae4b4 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:16.161896 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-07f0997f-9603-44b3-92f4-ce64afaae4b4 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:16.497934 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-07f0997f-9603-44b3-92f4-ce64afaae4b4 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:16.510697 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-07f0997f-9603-44b3-92f4-ce64afaae4b4 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0" status: 200 len: 1321 microversion: 2.1 time: 0.380974 Feb 17 04:37:16.511297 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 62/133] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:16 2021] GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0 => generated 1321 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:16.701741 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-f6fbf2bd-6e22-49f2-86d0-248542b2aff3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:16.702938 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-f6fbf2bd-6e22-49f2-86d0-248542b2aff3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:16.712086 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f6fbf2bd-6e22-49f2-86d0-248542b2aff3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:16.712815 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f6fbf2bd-6e22-49f2-86d0-248542b2aff3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:16.713733 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f6fbf2bd-6e22-49f2-86d0-248542b2aff3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:16.714288 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f6fbf2bd-6e22-49f2-86d0-248542b2aff3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:17.193441 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-f6fbf2bd-6e22-49f2-86d0-248542b2aff3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:17.211977 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-f6fbf2bd-6e22-49f2-86d0-248542b2aff3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:17.213692 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-f6fbf2bd-6e22-49f2-86d0-248542b2aff3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:17.216246 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-f6fbf2bd-6e22-49f2-86d0-248542b2aff3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1408 microversion: 2.20 time: 0.517596 Feb 17 04:37:17.217499 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 72/134] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:37:16 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1408 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:37:17.529096 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-3bb73949-c3fe-4988-88d8-d1c8f0c48778 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:17.529979 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-3bb73949-c3fe-4988-88d8-d1c8f0c48778 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 1c099afc-d941-4044-83cc-39185d6d57b0] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:17.546925 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-3bb73949-c3fe-4988-88d8-d1c8f0c48778 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:17.546925 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-3bb73949-c3fe-4988-88d8-d1c8f0c48778 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:17.546925 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-3bb73949-c3fe-4988-88d8-d1c8f0c48778 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:17.546925 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-3bb73949-c3fe-4988-88d8-d1c8f0c48778 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:18.026957 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-3bb73949-c3fe-4988-88d8-d1c8f0c48778 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:18.037030 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-3bb73949-c3fe-4988-88d8-d1c8f0c48778 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0" status: 200 len: 1321 microversion: 2.1 time: 0.512519 Feb 17 04:37:18.040468 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 63/135] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:17 2021] GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0 => generated 1321 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:18.072209 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [req-abc657a7-03b9-405c-8b53-200cb99ba45c req-511f5fae-63ed-4332-88f2-817288d56a21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d9c77fb-c4b1-4b48-a00a-b85af63c8920", "name": "network-vif-plugged", "status": "completed", "tag": "f8a409c8-c8d0-47e0-b35c-7b5830e57e6e"}, {"server_uuid": "1c099afc-d941-4044-83cc-39185d6d57b0", "name": "network-vif-plugged", "status": "completed", "tag": "1dc54b74-4d8c-493a-918e-f2cbda4994d3"}]} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:37:18.075592 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:37:18.075592 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:37:18.106125 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-abc657a7-03b9-405c-8b53-200cb99ba45c req-511f5fae-63ed-4332-88f2-817288d56a21 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:18.106689 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-abc657a7-03b9-405c-8b53-200cb99ba45c req-511f5fae-63ed-4332-88f2-817288d56a21 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:18.130755 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.compute.server_external_events [req-abc657a7-03b9-405c-8b53-200cb99ba45c req-511f5fae-63ed-4332-88f2-817288d56a21 service nova] Creating event network-vif-plugged:f8a409c8-c8d0-47e0-b35c-7b5830e57e6e for instance 8d9c77fb-c4b1-4b48-a00a-b85af63c8920 on hv-cinder-76019 Feb 17 04:37:18.132331 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.compute.server_external_events [req-abc657a7-03b9-405c-8b53-200cb99ba45c req-511f5fae-63ed-4332-88f2-817288d56a21 service nova] Creating event network-vif-plugged:1dc54b74-4d8c-493a-918e-f2cbda4994d3 for instance 1c099afc-d941-4044-83cc-39185d6d57b0 on hv-cinder-76019 Feb 17 04:37:18.141595 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [req-abc657a7-03b9-405c-8b53-200cb99ba45c req-511f5fae-63ed-4332-88f2-817288d56a21 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.075531 Feb 17 04:37:18.142477 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 73/136] 10.222.0.38 () {64 vars in 1308 bytes} [Wed Feb 17 04:37:18 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:37:18.237498 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-cf1e6e39-8c74-4e1d-8bc9-91b656d49016 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:18.238318 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-cf1e6e39-8c74-4e1d-8bc9-91b656d49016 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:18.248566 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-cf1e6e39-8c74-4e1d-8bc9-91b656d49016 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:18.249081 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-cf1e6e39-8c74-4e1d-8bc9-91b656d49016 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:18.249941 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-cf1e6e39-8c74-4e1d-8bc9-91b656d49016 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:18.250440 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-cf1e6e39-8c74-4e1d-8bc9-91b656d49016 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:18.681786 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-cf1e6e39-8c74-4e1d-8bc9-91b656d49016 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:18.691547 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-cf1e6e39-8c74-4e1d-8bc9-91b656d49016 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:18.693113 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-cf1e6e39-8c74-4e1d-8bc9-91b656d49016 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:18.700693 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-cf1e6e39-8c74-4e1d-8bc9-91b656d49016 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1408 microversion: 2.20 time: 0.462519 Feb 17 04:37:18.701366 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 64/137] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:37:18 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1408 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:37:19.064409 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-c189061c-74be-4f99-9c7f-d12517f1c7d1 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:19.068987 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-c189061c-74be-4f99-9c7f-d12517f1c7d1 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 1c099afc-d941-4044-83cc-39185d6d57b0] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:19.085002 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c189061c-74be-4f99-9c7f-d12517f1c7d1 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:19.085966 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c189061c-74be-4f99-9c7f-d12517f1c7d1 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:19.087088 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c189061c-74be-4f99-9c7f-d12517f1c7d1 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:19.087890 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c189061c-74be-4f99-9c7f-d12517f1c7d1 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:19.486739 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-c189061c-74be-4f99-9c7f-d12517f1c7d1 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:19.507958 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-c189061c-74be-4f99-9c7f-d12517f1c7d1 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0" status: 200 len: 1321 microversion: 2.1 time: 0.456092 Feb 17 04:37:19.508635 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 74/138] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:19 2021] GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0 => generated 1321 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:19.720392 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-2793438c-430e-4aac-9eb5-ad260d787870 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:19.721047 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-2793438c-430e-4aac-9eb5-ad260d787870 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:19.729523 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2793438c-430e-4aac-9eb5-ad260d787870 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:19.730037 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2793438c-430e-4aac-9eb5-ad260d787870 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:19.730884 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2793438c-430e-4aac-9eb5-ad260d787870 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:19.731551 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2793438c-430e-4aac-9eb5-ad260d787870 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:20.050477 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-2793438c-430e-4aac-9eb5-ad260d787870 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:20.061549 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-2793438c-430e-4aac-9eb5-ad260d787870 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:20.063145 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-2793438c-430e-4aac-9eb5-ad260d787870 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:20.064272 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-2793438c-430e-4aac-9eb5-ad260d787870 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1408 microversion: 2.20 time: 0.347941 Feb 17 04:37:20.069631 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 65/139] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:37:19 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1408 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:37:20.527340 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-cb972321-be2f-4ebf-bfab-0d9b2201638e tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:20.528113 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-cb972321-be2f-4ebf-bfab-0d9b2201638e tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 1c099afc-d941-4044-83cc-39185d6d57b0] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:20.537164 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-cb972321-be2f-4ebf-bfab-0d9b2201638e tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:20.537972 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-cb972321-be2f-4ebf-bfab-0d9b2201638e tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:20.539067 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-cb972321-be2f-4ebf-bfab-0d9b2201638e tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:20.539716 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-cb972321-be2f-4ebf-bfab-0d9b2201638e tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:20.882731 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-cb972321-be2f-4ebf-bfab-0d9b2201638e tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:20.893707 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-cb972321-be2f-4ebf-bfab-0d9b2201638e tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0" status: 200 len: 1321 microversion: 2.1 time: 0.372067 Feb 17 04:37:20.899902 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 75/140] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:20 2021] GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0 => generated 1321 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:21.094451 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-409907c6-a40e-4deb-86d4-bc9e431fa6aa tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:21.094451 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-409907c6-a40e-4deb-86d4-bc9e431fa6aa tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:21.094451 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-409907c6-a40e-4deb-86d4-bc9e431fa6aa tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:21.094451 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-409907c6-a40e-4deb-86d4-bc9e431fa6aa tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:21.094944 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-409907c6-a40e-4deb-86d4-bc9e431fa6aa tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:21.094944 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-409907c6-a40e-4deb-86d4-bc9e431fa6aa tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:21.323853 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-409907c6-a40e-4deb-86d4-bc9e431fa6aa tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:21.334686 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-409907c6-a40e-4deb-86d4-bc9e431fa6aa tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:21.336534 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-409907c6-a40e-4deb-86d4-bc9e431fa6aa tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:21.337905 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-409907c6-a40e-4deb-86d4-bc9e431fa6aa tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1600 microversion: 2.20 time: 0.258393 Feb 17 04:37:21.338475 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 66/141] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:37:21 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1600 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:37:21.359608 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-c3ed25d5-db4f-477b-b1fb-fe1d5b842c24 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:21.360332 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-c3ed25d5-db4f-477b-b1fb-fe1d5b842c24 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:21.370721 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c3ed25d5-db4f-477b-b1fb-fe1d5b842c24 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:21.371920 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c3ed25d5-db4f-477b-b1fb-fe1d5b842c24 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:21.372964 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c3ed25d5-db4f-477b-b1fb-fe1d5b842c24 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:21.373939 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c3ed25d5-db4f-477b-b1fb-fe1d5b842c24 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:21.567520 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-c3ed25d5-db4f-477b-b1fb-fe1d5b842c24 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.211807 Feb 17 04:37:21.569502 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 76/142] 10.222.0.38 () {60 vars in 1306 bytes} [Wed Feb 17 04:37:21 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/os-interface => generated 284 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:37:21.921567 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-1109c872-7362-4243-8273-9d4cca8813ed tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:21.924628 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-1109c872-7362-4243-8273-9d4cca8813ed tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 1c099afc-d941-4044-83cc-39185d6d57b0] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:21.959209 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1109c872-7362-4243-8273-9d4cca8813ed tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:21.963911 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1109c872-7362-4243-8273-9d4cca8813ed tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:21.964963 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1109c872-7362-4243-8273-9d4cca8813ed tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:21.968787 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1109c872-7362-4243-8273-9d4cca8813ed tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:23.177687 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-1109c872-7362-4243-8273-9d4cca8813ed tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:23.190203 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-1109c872-7362-4243-8273-9d4cca8813ed tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0" status: 200 len: 1515 microversion: 2.1 time: 1.282220 Feb 17 04:37:23.191454 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 67/143] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:21 2021] GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0 => generated 1515 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:23.209524 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-a8f3036d-93f4-419d-a674-ede5151c0d0a tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:37:23.211389 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-a8f3036d-93f4-419d-a674-ede5151c0d0a tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 1c099afc-d941-4044-83cc-39185d6d57b0] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:23.228294 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a8f3036d-93f4-419d-a674-ede5151c0d0a tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:23.229055 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a8f3036d-93f4-419d-a674-ede5151c0d0a tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:23.230132 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a8f3036d-93f4-419d-a674-ede5151c0d0a tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:23.231536 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a8f3036d-93f4-419d-a674-ede5151c0d0a tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:23.308480 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.objects.instance [None req-a8f3036d-93f4-419d-a674-ede5151c0d0a tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lazy-loading 'flavor' on Instance uuid 1c099afc-d941-4044-83cc-39185d6d57b0 {{(pid=98081) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:37:23.406520 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-6f27c456-ea89-47cb-9008-7d37146199db tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:23.407341 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-6f27c456-ea89-47cb-9008-7d37146199db tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] [instance: eef504a5-c89a-46d6-b032-3f78f265ed79] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:23.416067 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6f27c456-ea89-47cb-9008-7d37146199db tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:23.416774 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6f27c456-ea89-47cb-9008-7d37146199db tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:23.417765 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6f27c456-ea89-47cb-9008-7d37146199db tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:23.418402 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6f27c456-ea89-47cb-9008-7d37146199db tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:23.536490 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-6f27c456-ea89-47cb-9008-7d37146199db tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] [instance: eef504a5-c89a-46d6-b032-3f78f265ed79] Going to try to terminate instance {{(pid=98080) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 04:37:23.562260 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-a8f3036d-93f4-419d-a674-ede5151c0d0a tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "POST /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0/action" status: 200 len: 32 microversion: 2.1 time: 0.356788 Feb 17 04:37:23.562981 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 77/144] 10.222.0.38 () {60 vars in 1268 bytes} [Wed Feb 17 04:37:23 2021] POST /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0/action => generated 32 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:37:23.586474 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-b3354951-c516-414d-87c4-28025c1f2ee6 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:23.589580 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-b3354951-c516-414d-87c4-28025c1f2ee6 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 1c099afc-d941-4044-83cc-39185d6d57b0] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:23.601383 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b3354951-c516-414d-87c4-28025c1f2ee6 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:23.601934 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b3354951-c516-414d-87c4-28025c1f2ee6 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:23.603099 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b3354951-c516-414d-87c4-28025c1f2ee6 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:23.603593 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b3354951-c516-414d-87c4-28025c1f2ee6 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:23.802293 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-6f27c456-ea89-47cb-9008-7d37146199db tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] 10.222.0.38 "DELETE /compute/v2.1/servers/eef504a5-c89a-46d6-b032-3f78f265ed79" status: 204 len: 0 microversion: 2.1 time: 0.399271 Feb 17 04:37:23.807250 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 68/145] 10.222.0.38 () {58 vars in 1229 bytes} [Wed Feb 17 04:37:23 2021] DELETE /compute/v2.1/servers/eef504a5-c89a-46d6-b032-3f78f265ed79 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 17 04:37:23.814178 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-2aa7bb65-ceaa-49f9-a839-b610af521189 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:23.815312 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-2aa7bb65-ceaa-49f9-a839-b610af521189 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] [instance: eef504a5-c89a-46d6-b032-3f78f265ed79] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:23.824581 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2aa7bb65-ceaa-49f9-a839-b610af521189 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:23.825095 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2aa7bb65-ceaa-49f9-a839-b610af521189 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:23.826325 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2aa7bb65-ceaa-49f9-a839-b610af521189 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:23.827832 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2aa7bb65-ceaa-49f9-a839-b610af521189 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:24.331617 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-b3354951-c516-414d-87c4-28025c1f2ee6 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:24.345859 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-b3354951-c516-414d-87c4-28025c1f2ee6 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0" status: 200 len: 1521 microversion: 2.1 time: 0.776963 Feb 17 04:37:24.357829 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 78/146] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:23 2021] GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0 => generated 1521 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:37:24.840573 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-2aa7bb65-ceaa-49f9-a839-b610af521189 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b74b528e2d4778a5f82cba65fcc178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c8bf81d567949c194eb63efc45f5bdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:24.851251 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-2aa7bb65-ceaa-49f9-a839-b610af521189 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] 10.222.0.38 "GET /compute/v2.1/servers/eef504a5-c89a-46d6-b032-3f78f265ed79" status: 200 len: 1553 microversion: 2.1 time: 1.042462 Feb 17 04:37:24.852478 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 69/147] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:23 2021] GET /compute/v2.1/servers/eef504a5-c89a-46d6-b032-3f78f265ed79 => generated 1553 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:25.293492 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-3527179c-8085-4cc9-b479-24a11dc36803 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:37:25.294846 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-3527179c-8085-4cc9-b479-24a11dc36803 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:25.300498 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [req-0bef41cd-c26a-4646-b74c-249613db9b24 req-34e5fbc0-2d35-490b-bbb6-1cf80f16c1c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d9c77fb-c4b1-4b48-a00a-b85af63c8920", "tag": "f8a409c8-c8d0-47e0-b35c-7b5830e57e6e"}]} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:37:25.302394 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:37:25.302394 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:37:25.311049 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-3527179c-8085-4cc9-b479-24a11dc36803 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:25.311776 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-3527179c-8085-4cc9-b479-24a11dc36803 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:25.312827 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-3527179c-8085-4cc9-b479-24a11dc36803 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:25.315142 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-3527179c-8085-4cc9-b479-24a11dc36803 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:25.322096 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-0bef41cd-c26a-4646-b74c-249613db9b24 req-34e5fbc0-2d35-490b-bbb6-1cf80f16c1c7 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:25.326108 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-0bef41cd-c26a-4646-b74c-249613db9b24 req-34e5fbc0-2d35-490b-bbb6-1cf80f16c1c7 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:25.346529 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.compute.server_external_events [req-0bef41cd-c26a-4646-b74c-249613db9b24 req-34e5fbc0-2d35-490b-bbb6-1cf80f16c1c7 service nova] Creating event network-changed:f8a409c8-c8d0-47e0-b35c-7b5830e57e6e for instance 8d9c77fb-c4b1-4b48-a00a-b85af63c8920 on hv-cinder-76019 Feb 17 04:37:25.354434 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [req-0bef41cd-c26a-4646-b74c-249613db9b24 req-34e5fbc0-2d35-490b-bbb6-1cf80f16c1c7 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058318 Feb 17 04:37:25.355451 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 70/148] 10.222.0.38 () {64 vars in 1308 bytes} [Wed Feb 17 04:37:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:37:25.366618 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-8b60da14-f70a-4642-9fd8-ff0bc4758f8a tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:25.367713 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-8b60da14-f70a-4642-9fd8-ff0bc4758f8a tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 1c099afc-d941-4044-83cc-39185d6d57b0] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:25.378791 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8b60da14-f70a-4642-9fd8-ff0bc4758f8a tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:25.379623 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8b60da14-f70a-4642-9fd8-ff0bc4758f8a tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:25.380927 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8b60da14-f70a-4642-9fd8-ff0bc4758f8a tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:25.381708 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8b60da14-f70a-4642-9fd8-ff0bc4758f8a tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:25.604175 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-3527179c-8085-4cc9-b479-24a11dc36803 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "POST /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/action" status: 200 len: 14 microversion: 2.20 time: 0.314498 Feb 17 04:37:25.604892 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 79/149] 10.222.0.38 () {62 vars in 1309 bytes} [Wed Feb 17 04:37:25 2021] POST /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/action => generated 14 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:25.736411 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-8b60da14-f70a-4642-9fd8-ff0bc4758f8a tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:25.753122 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-8b60da14-f70a-4642-9fd8-ff0bc4758f8a tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0" status: 200 len: 1521 microversion: 2.1 time: 0.391811 Feb 17 04:37:25.753924 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 71/150] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:25 2021] GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0 => generated 1521 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:37:25.871098 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-e1d6f544-e73d-4e1b-8a0a-d387d3d33b96 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:25.872143 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-e1d6f544-e73d-4e1b-8a0a-d387d3d33b96 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] [instance: eef504a5-c89a-46d6-b032-3f78f265ed79] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:25.882852 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e1d6f544-e73d-4e1b-8a0a-d387d3d33b96 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:25.883651 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e1d6f544-e73d-4e1b-8a0a-d387d3d33b96 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:25.884699 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e1d6f544-e73d-4e1b-8a0a-d387d3d33b96 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:25.885367 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e1d6f544-e73d-4e1b-8a0a-d387d3d33b96 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:26.269277 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-e1d6f544-e73d-4e1b-8a0a-d387d3d33b96 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b74b528e2d4778a5f82cba65fcc178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c8bf81d567949c194eb63efc45f5bdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:26.280066 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-e1d6f544-e73d-4e1b-8a0a-d387d3d33b96 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] 10.222.0.38 "GET /compute/v2.1/servers/eef504a5-c89a-46d6-b032-3f78f265ed79" status: 200 len: 1553 microversion: 2.1 time: 0.413971 Feb 17 04:37:26.281002 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 80/151] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:25 2021] GET /compute/v2.1/servers/eef504a5-c89a-46d6-b032-3f78f265ed79 => generated 1553 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:26.618030 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-c3294482-b6eb-4511-ac48-5d033531a645 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:37:26.620123 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-c3294482-b6eb-4511-ac48-5d033531a645 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:26.659338 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c3294482-b6eb-4511-ac48-5d033531a645 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:26.660086 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c3294482-b6eb-4511-ac48-5d033531a645 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:26.664504 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c3294482-b6eb-4511-ac48-5d033531a645 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:26.665269 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c3294482-b6eb-4511-ac48-5d033531a645 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:26.775670 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-0c0db7e4-b01d-4c14-a0f1-6636e62e4ef6 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:26.776324 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-0c0db7e4-b01d-4c14-a0f1-6636e62e4ef6 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 1c099afc-d941-4044-83cc-39185d6d57b0] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:26.788722 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0c0db7e4-b01d-4c14-a0f1-6636e62e4ef6 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:26.789701 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0c0db7e4-b01d-4c14-a0f1-6636e62e4ef6 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:26.791091 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0c0db7e4-b01d-4c14-a0f1-6636e62e4ef6 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:26.791792 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0c0db7e4-b01d-4c14-a0f1-6636e62e4ef6 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:26.884824 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-c3294482-b6eb-4511-ac48-5d033531a645 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "POST /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/action" status: 200 len: 14 microversion: 2.20 time: 0.272504 Feb 17 04:37:26.888332 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 72/152] 10.222.0.38 () {62 vars in 1309 bytes} [Wed Feb 17 04:37:26 2021] POST /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/action => generated 14 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:27.232555 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [req-8dcbe401-0d31-4d02-a761-f81132cdada4 req-bb4773af-d4d7-423e-8855-2113069fd88d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eef504a5-c89a-46d6-b032-3f78f265ed79", "name": "network-vif-unplugged", "status": "completed", "tag": "9be13024-0135-468a-a333-ad54ca5b0575"}]} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:37:27.234388 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:37:27.234388 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:37:27.253456 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-8dcbe401-0d31-4d02-a761-f81132cdada4 req-bb4773af-d4d7-423e-8855-2113069fd88d service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:27.254060 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-8dcbe401-0d31-4d02-a761-f81132cdada4 req-bb4773af-d4d7-423e-8855-2113069fd88d service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:27.279565 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.compute.server_external_events [req-8dcbe401-0d31-4d02-a761-f81132cdada4 req-bb4773af-d4d7-423e-8855-2113069fd88d service nova] Creating event network-vif-unplugged:9be13024-0135-468a-a333-ad54ca5b0575 for instance eef504a5-c89a-46d6-b032-3f78f265ed79 on hv-cinder-76019 Feb 17 04:37:27.285183 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [req-8dcbe401-0d31-4d02-a761-f81132cdada4 req-bb4773af-d4d7-423e-8855-2113069fd88d service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057076 Feb 17 04:37:27.286296 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 73/153] 10.222.0.38 () {64 vars in 1308 bytes} [Wed Feb 17 04:37:27 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:37:27.302324 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-e498d723-68a5-4875-afec-2e8f2fe5f464 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:27.303888 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-e498d723-68a5-4875-afec-2e8f2fe5f464 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] [instance: eef504a5-c89a-46d6-b032-3f78f265ed79] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:27.328337 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e498d723-68a5-4875-afec-2e8f2fe5f464 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:27.329149 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e498d723-68a5-4875-afec-2e8f2fe5f464 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:27.330832 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e498d723-68a5-4875-afec-2e8f2fe5f464 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:27.331581 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e498d723-68a5-4875-afec-2e8f2fe5f464 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:27.443445 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-0c0db7e4-b01d-4c14-a0f1-6636e62e4ef6 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:27.456654 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-0c0db7e4-b01d-4c14-a0f1-6636e62e4ef6 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0" status: 200 len: 1521 microversion: 2.1 time: 0.686152 Feb 17 04:37:27.457291 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 81/154] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:26 2021] GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0 => generated 1521 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:27.896913 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-e223dca1-14c6-49dc-843d-7a6dc656ce83 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:37:27.898485 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-e223dca1-14c6-49dc-843d-7a6dc656ce83 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:27.910322 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e223dca1-14c6-49dc-843d-7a6dc656ce83 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:27.910840 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e223dca1-14c6-49dc-843d-7a6dc656ce83 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:27.920441 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e223dca1-14c6-49dc-843d-7a6dc656ce83 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:27.921319 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e223dca1-14c6-49dc-843d-7a6dc656ce83 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:27.941608 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-e498d723-68a5-4875-afec-2e8f2fe5f464 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b74b528e2d4778a5f82cba65fcc178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c8bf81d567949c194eb63efc45f5bdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:27.963152 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-e498d723-68a5-4875-afec-2e8f2fe5f464 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] 10.222.0.38 "GET /compute/v2.1/servers/eef504a5-c89a-46d6-b032-3f78f265ed79" status: 200 len: 1553 microversion: 2.1 time: 0.665593 Feb 17 04:37:27.967681 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 74/155] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:27 2021] GET /compute/v2.1/servers/eef504a5-c89a-46d6-b032-3f78f265ed79 => generated 1553 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:28.058724 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-e223dca1-14c6-49dc-843d-7a6dc656ce83 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "POST /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/action" status: 200 len: 14 microversion: 2.20 time: 0.165945 Feb 17 04:37:28.062606 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 82/156] 10.222.0.38 () {62 vars in 1309 bytes} [Wed Feb 17 04:37:27 2021] POST /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/action => generated 14 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:28.478831 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-23064d68-ae7b-42ac-ae4b-3a3dc01b922e tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:28.478831 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-23064d68-ae7b-42ac-ae4b-3a3dc01b922e tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 1c099afc-d941-4044-83cc-39185d6d57b0] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:28.485481 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-23064d68-ae7b-42ac-ae4b-3a3dc01b922e tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:28.486153 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-23064d68-ae7b-42ac-ae4b-3a3dc01b922e tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:28.487124 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-23064d68-ae7b-42ac-ae4b-3a3dc01b922e tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:28.487706 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-23064d68-ae7b-42ac-ae4b-3a3dc01b922e tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:28.987601 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-fac87119-66de-4427-9e8d-2477b47fcb20 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:28.988376 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-fac87119-66de-4427-9e8d-2477b47fcb20 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] [instance: eef504a5-c89a-46d6-b032-3f78f265ed79] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:29.012770 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-fac87119-66de-4427-9e8d-2477b47fcb20 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:29.014411 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-fac87119-66de-4427-9e8d-2477b47fcb20 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:29.017986 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-fac87119-66de-4427-9e8d-2477b47fcb20 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:29.018725 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-fac87119-66de-4427-9e8d-2477b47fcb20 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:29.051508 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-23064d68-ae7b-42ac-ae4b-3a3dc01b922e tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:29.064547 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-23064d68-ae7b-42ac-ae4b-3a3dc01b922e tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0" status: 200 len: 1521 microversion: 2.1 time: 0.593298 Feb 17 04:37:29.069361 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 75/157] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:28 2021] GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0 => generated 1521 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:29.077489 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-339f3c4c-8874-4ad8-9d5c-e6f3eb4db6df tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:37:29.084432 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-339f3c4c-8874-4ad8-9d5c-e6f3eb4db6df tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:29.099826 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-339f3c4c-8874-4ad8-9d5c-e6f3eb4db6df tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:29.102676 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-339f3c4c-8874-4ad8-9d5c-e6f3eb4db6df tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:29.103950 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-339f3c4c-8874-4ad8-9d5c-e6f3eb4db6df tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:29.104574 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-339f3c4c-8874-4ad8-9d5c-e6f3eb4db6df tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:29.233453 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-339f3c4c-8874-4ad8-9d5c-e6f3eb4db6df tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "POST /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/action" status: 200 len: 14 microversion: 2.20 time: 0.162465 Feb 17 04:37:29.237042 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 76/158] 10.222.0.38 () {62 vars in 1309 bytes} [Wed Feb 17 04:37:29 2021] POST /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/action => generated 14 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:29.720785 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-fac87119-66de-4427-9e8d-2477b47fcb20 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b74b528e2d4778a5f82cba65fcc178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c8bf81d567949c194eb63efc45f5bdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:29.735716 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-fac87119-66de-4427-9e8d-2477b47fcb20 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] 10.222.0.38 "GET /compute/v2.1/servers/eef504a5-c89a-46d6-b032-3f78f265ed79" status: 200 len: 1553 microversion: 2.1 time: 0.753331 Feb 17 04:37:29.736320 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 83/159] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:28 2021] GET /compute/v2.1/servers/eef504a5-c89a-46d6-b032-3f78f265ed79 => generated 1553 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:37:29.926620 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [req-963105db-8dbd-418a-b09c-7c5c98c32996 req-ab14cba9-323b-4fff-b336-f99613c24790 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eef504a5-c89a-46d6-b032-3f78f265ed79", "name": "network-vif-deleted", "tag": "9be13024-0135-468a-a333-ad54ca5b0575"}]} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:37:29.929917 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:37:29.929917 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:37:29.943015 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-963105db-8dbd-418a-b09c-7c5c98c32996 req-ab14cba9-323b-4fff-b336-f99613c24790 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:29.958537 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-963105db-8dbd-418a-b09c-7c5c98c32996 req-ab14cba9-323b-4fff-b336-f99613c24790 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:29.995206 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.compute.server_external_events [req-963105db-8dbd-418a-b09c-7c5c98c32996 req-ab14cba9-323b-4fff-b336-f99613c24790 service nova] Creating event network-vif-deleted:9be13024-0135-468a-a333-ad54ca5b0575 for instance eef504a5-c89a-46d6-b032-3f78f265ed79 on hv-cinder-76019 Feb 17 04:37:30.003206 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [req-963105db-8dbd-418a-b09c-7c5c98c32996 req-ab14cba9-323b-4fff-b336-f99613c24790 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081427 Feb 17 04:37:30.004112 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 77/160] 10.222.0.38 () {64 vars in 1308 bytes} [Wed Feb 17 04:37:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:37:30.084929 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-18bcc81e-bfc4-476f-9731-a78f151bea5e tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:30.094052 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-18bcc81e-bfc4-476f-9731-a78f151bea5e tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 1c099afc-d941-4044-83cc-39185d6d57b0] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:30.126863 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-18bcc81e-bfc4-476f-9731-a78f151bea5e tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:30.139356 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-18bcc81e-bfc4-476f-9731-a78f151bea5e tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:30.140440 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-18bcc81e-bfc4-476f-9731-a78f151bea5e tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:30.141567 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-18bcc81e-bfc4-476f-9731-a78f151bea5e tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:30.246626 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-d22f4088-974d-41ae-a403-7ed5fd52821e tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:37:30.247883 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-d22f4088-974d-41ae-a403-7ed5fd52821e tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:30.261577 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d22f4088-974d-41ae-a403-7ed5fd52821e tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:30.262088 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d22f4088-974d-41ae-a403-7ed5fd52821e tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:30.262988 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d22f4088-974d-41ae-a403-7ed5fd52821e tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:30.263488 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d22f4088-974d-41ae-a403-7ed5fd52821e tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:30.439019 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-18bcc81e-bfc4-476f-9731-a78f151bea5e tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:30.449473 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-18bcc81e-bfc4-476f-9731-a78f151bea5e tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0" status: 200 len: 1521 microversion: 2.1 time: 0.368983 Feb 17 04:37:30.450074 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 84/161] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:30 2021] GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0 => generated 1521 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:30.457474 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-d22f4088-974d-41ae-a403-7ed5fd52821e tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "POST /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/action" status: 200 len: 14 microversion: 2.20 time: 0.209488 Feb 17 04:37:30.457474 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 78/162] 10.222.0.38 () {62 vars in 1309 bytes} [Wed Feb 17 04:37:30 2021] POST /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/action => generated 14 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:30.755068 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-7258e250-30d8-4997-a97e-bc048b9d840c tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:30.756355 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-7258e250-30d8-4997-a97e-bc048b9d840c tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] [instance: eef504a5-c89a-46d6-b032-3f78f265ed79] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:30.765807 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7258e250-30d8-4997-a97e-bc048b9d840c tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:30.766646 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7258e250-30d8-4997-a97e-bc048b9d840c tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:30.767727 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7258e250-30d8-4997-a97e-bc048b9d840c tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:30.768759 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7258e250-30d8-4997-a97e-bc048b9d840c tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:30.968385 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-7258e250-30d8-4997-a97e-bc048b9d840c tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b74b528e2d4778a5f82cba65fcc178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c8bf81d567949c194eb63efc45f5bdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:30.989644 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-7258e250-30d8-4997-a97e-bc048b9d840c tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] 10.222.0.38 "GET /compute/v2.1/servers/eef504a5-c89a-46d6-b032-3f78f265ed79" status: 200 len: 1345 microversion: 2.1 time: 0.236847 Feb 17 04:37:30.989644 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 79/163] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:30 2021] GET /compute/v2.1/servers/eef504a5-c89a-46d6-b032-3f78f265ed79 => generated 1345 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:31.215245 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-5f8dce66-0278-475d-a057-d04c30721581 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1152959374", "imageRef": "2d6991a7-a1f0-444b-8fd5-d05558b5f9a4", "flavorRef": "452", "networks": [{"uuid": "3eac4670-46fd-4c18-9c55-ed035eb365fd"}]}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:37:31.284834 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.network.neutron [None req-5f8dce66-0278-475d-a057-d04c30721581 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] validate_networks() for [('3eac4670-46fd-4c18-9c55-ed035eb365fd', None, None, None)] {{(pid=98081) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 04:37:31.464064 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-347e7656-8ec1-4b57-83d5-6c3d2cd17e88 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:37:31.465338 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-347e7656-8ec1-4b57-83d5-6c3d2cd17e88 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:31.474059 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-347e7656-8ec1-4b57-83d5-6c3d2cd17e88 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:31.474891 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-347e7656-8ec1-4b57-83d5-6c3d2cd17e88 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:31.476024 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-347e7656-8ec1-4b57-83d5-6c3d2cd17e88 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:31.477017 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-347e7656-8ec1-4b57-83d5-6c3d2cd17e88 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:31.881672 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-5f8dce66-0278-475d-a057-d04c30721581 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Flavor limits 0:0:0 {{(pid=98081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 04:37:31.882146 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-5f8dce66-0278-475d-a057-d04c30721581 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Image limits 0:0:0 {{(pid=98081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 04:37:31.882709 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-5f8dce66-0278-475d-a057-d04c30721581 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Flavor pref 0:0:0 {{(pid=98081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 04:37:31.883175 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-5f8dce66-0278-475d-a057-d04c30721581 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Image pref 0:0:0 {{(pid=98081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 04:37:31.883752 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-5f8dce66-0278-475d-a057-d04c30721581 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 04:37:31.892652 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5f8dce66-0278-475d-a057-d04c30721581 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:31.893160 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5f8dce66-0278-475d-a057-d04c30721581 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:31.894070 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5f8dce66-0278-475d-a057-d04c30721581 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:31.894588 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5f8dce66-0278-475d-a057-d04c30721581 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:31.916395 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.quota [None req-5f8dce66-0278-475d-a057-d04c30721581 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Getting quotas for project a6284f2b80524eb0a36ccebaedba767a. Resources: {'instances', 'cores', 'ram'} {{(pid=98081) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:37:31.920850 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.quota [None req-5f8dce66-0278-475d-a057-d04c30721581 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Getting quotas for user 38a46d18160148f3a48ef4887f6ec7da and project a6284f2b80524eb0a36ccebaedba767a. Resources: {'instances', 'cores', 'ram'} {{(pid=98081) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:37:31.932336 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-5f8dce66-0278-475d-a057-d04c30721581 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Going to run 1 instances... {{(pid=98081) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 04:37:31.935263 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-5f8dce66-0278-475d-a057-d04c30721581 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: 5d8fcb1f-fa8f-4a61-8e8b-77a64053ca3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d6991a7-a1f0-444b-8fd5-d05558b5f9a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98081) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 04:37:31.996205 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-5f8dce66-0278-475d-a057-d04c30721581 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.784679 Feb 17 04:37:31.996912 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 85/164] 10.222.0.38 () {60 vars in 1137 bytes} [Wed Feb 17 04:37:31 2021] POST /compute/v2.1/servers => generated 380 bytes in 786 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 17 04:37:32.012918 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-dcb36532-4f4b-4546-a41e-4bb5ed5ecfe8 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:32.021090 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-dcb36532-4f4b-4546-a41e-4bb5ed5ecfe8 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 1c099afc-d941-4044-83cc-39185d6d57b0] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:32.030521 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-dcb36532-4f4b-4546-a41e-4bb5ed5ecfe8 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:32.031264 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-dcb36532-4f4b-4546-a41e-4bb5ed5ecfe8 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:32.032247 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-dcb36532-4f4b-4546-a41e-4bb5ed5ecfe8 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:32.033051 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-dcb36532-4f4b-4546-a41e-4bb5ed5ecfe8 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:32.295889 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-dcb36532-4f4b-4546-a41e-4bb5ed5ecfe8 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:32.304958 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-dcb36532-4f4b-4546-a41e-4bb5ed5ecfe8 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0" status: 200 len: 1521 microversion: 2.1 time: 0.300992 Feb 17 04:37:32.306355 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 86/165] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:31 2021] GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0 => generated 1521 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:32.311487 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-3832fc43-6fb3-4d1e-bd81-99f041bafa86 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:32.312152 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-3832fc43-6fb3-4d1e-bd81-99f041bafa86 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] [instance: eef504a5-c89a-46d6-b032-3f78f265ed79] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:32.321479 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-3832fc43-6fb3-4d1e-bd81-99f041bafa86 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:32.321978 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-3832fc43-6fb3-4d1e-bd81-99f041bafa86 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:32.323069 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-3832fc43-6fb3-4d1e-bd81-99f041bafa86 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:32.323575 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-3832fc43-6fb3-4d1e-bd81-99f041bafa86 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:32.460485 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-3832fc43-6fb3-4d1e-bd81-99f041bafa86 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b74b528e2d4778a5f82cba65fcc178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c8bf81d567949c194eb63efc45f5bdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:32.475902 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-3832fc43-6fb3-4d1e-bd81-99f041bafa86 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] 10.222.0.38 "GET /compute/v2.1/servers/eef504a5-c89a-46d6-b032-3f78f265ed79" status: 200 len: 1345 microversion: 2.1 time: 0.165124 Feb 17 04:37:32.476920 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 87/166] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:32 2021] GET /compute/v2.1/servers/eef504a5-c89a-46d6-b032-3f78f265ed79 => generated 1345 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:32.481901 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-07db94c7-0f83-4766-b555-3c6b76255d51 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:32.482590 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-07db94c7-0f83-4766-b555-3c6b76255d51 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: 5d8fcb1f-fa8f-4a61-8e8b-77a64053ca3c] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:32.491871 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-07db94c7-0f83-4766-b555-3c6b76255d51 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:32.492386 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-07db94c7-0f83-4766-b555-3c6b76255d51 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:32.493241 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-07db94c7-0f83-4766-b555-3c6b76255d51 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:32.493910 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-07db94c7-0f83-4766-b555-3c6b76255d51 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:32.626359 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-07db94c7-0f83-4766-b555-3c6b76255d51 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a46d18160148f3a48ef4887f6ec7da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6284f2b80524eb0a36ccebaedba767a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:32.636094 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-07db94c7-0f83-4766-b555-3c6b76255d51 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "GET /compute/v2.1/servers/5d8fcb1f-fa8f-4a61-8e8b-77a64053ca3c" status: 200 len: 1222 microversion: 2.1 time: 0.158042 Feb 17 04:37:32.636706 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 88/167] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:32 2021] GET /compute/v2.1/servers/5d8fcb1f-fa8f-4a61-8e8b-77a64053ca3c => generated 1222 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:33.324574 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-e2415029-3f6b-40ae-ac48-08da7034d7f0 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:33.325381 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-e2415029-3f6b-40ae-ac48-08da7034d7f0 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 1c099afc-d941-4044-83cc-39185d6d57b0] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:33.334648 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e2415029-3f6b-40ae-ac48-08da7034d7f0 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:33.335314 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e2415029-3f6b-40ae-ac48-08da7034d7f0 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:33.336507 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e2415029-3f6b-40ae-ac48-08da7034d7f0 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:33.337071 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e2415029-3f6b-40ae-ac48-08da7034d7f0 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:33.492835 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-347e7656-8ec1-4b57-83d5-6c3d2cd17e88 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "POST /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/action" status: 200 len: 14 microversion: 2.20 time: 2.034684 Feb 17 04:37:33.494033 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 80/168] 10.222.0.38 () {62 vars in 1309 bytes} [Wed Feb 17 04:37:31 2021] POST /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/action => generated 14 bytes in 2037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:33.500811 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-e477297c-ad4d-46df-b98a-6afb2a5f3f75 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:33.502050 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-e477297c-ad4d-46df-b98a-6afb2a5f3f75 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] [instance: eef504a5-c89a-46d6-b032-3f78f265ed79] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:33.512772 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e477297c-ad4d-46df-b98a-6afb2a5f3f75 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:33.513278 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e477297c-ad4d-46df-b98a-6afb2a5f3f75 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:33.514538 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e477297c-ad4d-46df-b98a-6afb2a5f3f75 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:33.515132 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e477297c-ad4d-46df-b98a-6afb2a5f3f75 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:33.578869 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-e2415029-3f6b-40ae-ac48-08da7034d7f0 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:33.589972 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-e2415029-3f6b-40ae-ac48-08da7034d7f0 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0" status: 200 len: 1521 microversion: 2.1 time: 0.269667 Feb 17 04:37:33.590882 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 89/169] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:33 2021] GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0 => generated 1521 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:37:33.646971 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-e477297c-ad4d-46df-b98a-6afb2a5f3f75 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b74b528e2d4778a5f82cba65fcc178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c8bf81d567949c194eb63efc45f5bdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:33.655556 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-9dceab59-c0f1-4145-84d2-d190b5583246 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:33.656523 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-9dceab59-c0f1-4145-84d2-d190b5583246 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: 5d8fcb1f-fa8f-4a61-8e8b-77a64053ca3c] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:33.664664 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-e477297c-ad4d-46df-b98a-6afb2a5f3f75 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] 10.222.0.38 "GET /compute/v2.1/servers/eef504a5-c89a-46d6-b032-3f78f265ed79" status: 200 len: 1345 microversion: 2.1 time: 0.169288 Feb 17 04:37:33.665438 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 81/170] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:33 2021] GET /compute/v2.1/servers/eef504a5-c89a-46d6-b032-3f78f265ed79 => generated 1345 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:33.666163 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9dceab59-c0f1-4145-84d2-d190b5583246 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:33.666843 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9dceab59-c0f1-4145-84d2-d190b5583246 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:33.667803 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9dceab59-c0f1-4145-84d2-d190b5583246 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:33.668429 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9dceab59-c0f1-4145-84d2-d190b5583246 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:33.803790 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-9dceab59-c0f1-4145-84d2-d190b5583246 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a46d18160148f3a48ef4887f6ec7da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6284f2b80524eb0a36ccebaedba767a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:33.812935 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-9dceab59-c0f1-4145-84d2-d190b5583246 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "GET /compute/v2.1/servers/5d8fcb1f-fa8f-4a61-8e8b-77a64053ca3c" status: 200 len: 1214 microversion: 2.1 time: 0.161374 Feb 17 04:37:33.813536 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 90/171] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:33 2021] GET /compute/v2.1/servers/5d8fcb1f-fa8f-4a61-8e8b-77a64053ca3c => generated 1214 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:34.505447 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-c0561411-a671-4cce-be77-8f49d212c318 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:37:34.507254 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-c0561411-a671-4cce-be77-8f49d212c318 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:34.522037 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c0561411-a671-4cce-be77-8f49d212c318 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:34.522037 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c0561411-a671-4cce-be77-8f49d212c318 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:34.522037 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c0561411-a671-4cce-be77-8f49d212c318 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:34.522037 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c0561411-a671-4cce-be77-8f49d212c318 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:34.608881 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-db5e083e-b942-4ea6-a958-0f101b47e171 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:34.609647 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-db5e083e-b942-4ea6-a958-0f101b47e171 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 1c099afc-d941-4044-83cc-39185d6d57b0] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:34.618492 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-db5e083e-b942-4ea6-a958-0f101b47e171 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:34.619185 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-db5e083e-b942-4ea6-a958-0f101b47e171 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:34.620155 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-db5e083e-b942-4ea6-a958-0f101b47e171 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:34.620736 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-db5e083e-b942-4ea6-a958-0f101b47e171 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:34.839352 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-db5e083e-b942-4ea6-a958-0f101b47e171 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:34.848119 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-db5e083e-b942-4ea6-a958-0f101b47e171 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0" status: 200 len: 1521 microversion: 2.1 time: 0.243307 Feb 17 04:37:34.848725 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 91/172] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:34 2021] GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0 => generated 1521 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:34.854099 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-d99d98f6-8fa6-40ef-afca-2e641acbeeb4 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:34.854733 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-d99d98f6-8fa6-40ef-afca-2e641acbeeb4 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] [instance: eef504a5-c89a-46d6-b032-3f78f265ed79] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:34.862349 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d99d98f6-8fa6-40ef-afca-2e641acbeeb4 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:34.862908 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d99d98f6-8fa6-40ef-afca-2e641acbeeb4 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:34.863786 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d99d98f6-8fa6-40ef-afca-2e641acbeeb4 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:34.864288 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d99d98f6-8fa6-40ef-afca-2e641acbeeb4 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:34.939263 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d99d98f6-8fa6-40ef-afca-2e641acbeeb4 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:34.939776 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d99d98f6-8fa6-40ef-afca-2e641acbeeb4 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:34.940289 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.objects.instance [None req-d99d98f6-8fa6-40ef-afca-2e641acbeeb4 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lazy-loading 'fault' on Instance uuid eef504a5-c89a-46d6-b032-3f78f265ed79 {{(pid=98081) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:37:35.010916 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-d99d98f6-8fa6-40ef-afca-2e641acbeeb4 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b74b528e2d4778a5f82cba65fcc178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c8bf81d567949c194eb63efc45f5bdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:35.020607 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-d99d98f6-8fa6-40ef-afca-2e641acbeeb4 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] 10.222.0.38 "GET /compute/v2.1/servers/eef504a5-c89a-46d6-b032-3f78f265ed79" status: 200 len: 1350 microversion: 2.1 time: 0.170866 Feb 17 04:37:35.027960 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 92/173] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:34 2021] GET /compute/v2.1/servers/eef504a5-c89a-46d6-b032-3f78f265ed79 => generated 1350 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:35.027960 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-518f3016-7052-4bb4-874f-0eb5602fccf1 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:35.027960 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-518f3016-7052-4bb4-874f-0eb5602fccf1 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: 5d8fcb1f-fa8f-4a61-8e8b-77a64053ca3c] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:35.039109 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-518f3016-7052-4bb4-874f-0eb5602fccf1 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:35.039617 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-518f3016-7052-4bb4-874f-0eb5602fccf1 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:35.040649 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-518f3016-7052-4bb4-874f-0eb5602fccf1 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:35.041140 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-518f3016-7052-4bb4-874f-0eb5602fccf1 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:35.170920 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-518f3016-7052-4bb4-874f-0eb5602fccf1 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a46d18160148f3a48ef4887f6ec7da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6284f2b80524eb0a36ccebaedba767a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:35.180862 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-518f3016-7052-4bb4-874f-0eb5602fccf1 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "GET /compute/v2.1/servers/5d8fcb1f-fa8f-4a61-8e8b-77a64053ca3c" status: 200 len: 1278 microversion: 2.1 time: 0.158058 Feb 17 04:37:35.181462 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 93/174] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:35 2021] GET /compute/v2.1/servers/5d8fcb1f-fa8f-4a61-8e8b-77a64053ca3c => generated 1278 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:35.866175 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-7281f333-ed48-4234-b350-4181cb7d1b07 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:35.866862 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-7281f333-ed48-4234-b350-4181cb7d1b07 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 1c099afc-d941-4044-83cc-39185d6d57b0] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:35.874680 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7281f333-ed48-4234-b350-4181cb7d1b07 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:35.875190 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7281f333-ed48-4234-b350-4181cb7d1b07 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:35.876027 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7281f333-ed48-4234-b350-4181cb7d1b07 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:35.876516 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7281f333-ed48-4234-b350-4181cb7d1b07 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:36.096602 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-7281f333-ed48-4234-b350-4181cb7d1b07 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:36.105616 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-7281f333-ed48-4234-b350-4181cb7d1b07 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0" status: 200 len: 1521 microversion: 2.1 time: 0.243371 Feb 17 04:37:36.106266 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 94/175] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:35 2021] GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0 => generated 1521 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:37:36.111120 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-62789474-c3af-472a-a5d2-83d3c97805ad tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:36.111788 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-62789474-c3af-472a-a5d2-83d3c97805ad tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] [instance: eef504a5-c89a-46d6-b032-3f78f265ed79] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:36.120776 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-62789474-c3af-472a-a5d2-83d3c97805ad tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:36.121310 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-62789474-c3af-472a-a5d2-83d3c97805ad tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:36.122309 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-62789474-c3af-472a-a5d2-83d3c97805ad tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:36.122895 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-62789474-c3af-472a-a5d2-83d3c97805ad tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:36.199189 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-62789474-c3af-472a-a5d2-83d3c97805ad tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:36.199746 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-62789474-c3af-472a-a5d2-83d3c97805ad tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:36.200254 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.objects.instance [None req-62789474-c3af-472a-a5d2-83d3c97805ad tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lazy-loading 'fault' on Instance uuid eef504a5-c89a-46d6-b032-3f78f265ed79 {{(pid=98081) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:37:36.262587 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-62789474-c3af-472a-a5d2-83d3c97805ad tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b74b528e2d4778a5f82cba65fcc178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c8bf81d567949c194eb63efc45f5bdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:36.272280 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-62789474-c3af-472a-a5d2-83d3c97805ad tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] 10.222.0.38 "GET /compute/v2.1/servers/eef504a5-c89a-46d6-b032-3f78f265ed79" status: 200 len: 1350 microversion: 2.1 time: 0.164834 Feb 17 04:37:36.272880 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 95/176] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:36 2021] GET /compute/v2.1/servers/eef504a5-c89a-46d6-b032-3f78f265ed79 => generated 1350 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:36.277402 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-cba42d99-715d-4dc9-b2a8-33361cc17a2c tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:36.278059 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-cba42d99-715d-4dc9-b2a8-33361cc17a2c tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: 5d8fcb1f-fa8f-4a61-8e8b-77a64053ca3c] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:36.285721 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-cba42d99-715d-4dc9-b2a8-33361cc17a2c tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:36.286231 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-cba42d99-715d-4dc9-b2a8-33361cc17a2c tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:36.288314 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-cba42d99-715d-4dc9-b2a8-33361cc17a2c tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:36.288881 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-cba42d99-715d-4dc9-b2a8-33361cc17a2c tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:36.422304 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-cba42d99-715d-4dc9-b2a8-33361cc17a2c tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a46d18160148f3a48ef4887f6ec7da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6284f2b80524eb0a36ccebaedba767a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:36.432059 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-cba42d99-715d-4dc9-b2a8-33361cc17a2c tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "GET /compute/v2.1/servers/5d8fcb1f-fa8f-4a61-8e8b-77a64053ca3c" status: 200 len: 1278 microversion: 2.1 time: 0.158029 Feb 17 04:37:36.432679 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 96/177] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:36 2021] GET /compute/v2.1/servers/5d8fcb1f-fa8f-4a61-8e8b-77a64053ca3c => generated 1278 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:37.125105 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-849abcf3-ddaa-49d9-9583-7a6b889e7b05 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:37.125764 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-849abcf3-ddaa-49d9-9583-7a6b889e7b05 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 1c099afc-d941-4044-83cc-39185d6d57b0] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:37.134580 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-849abcf3-ddaa-49d9-9583-7a6b889e7b05 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:37.135091 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-849abcf3-ddaa-49d9-9583-7a6b889e7b05 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:37.135912 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-849abcf3-ddaa-49d9-9583-7a6b889e7b05 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:37.136401 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-849abcf3-ddaa-49d9-9583-7a6b889e7b05 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:37.352912 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-849abcf3-ddaa-49d9-9583-7a6b889e7b05 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:37.361690 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-849abcf3-ddaa-49d9-9583-7a6b889e7b05 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0" status: 200 len: 1521 microversion: 2.1 time: 0.240734 Feb 17 04:37:37.362288 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 97/178] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:37 2021] GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0 => generated 1521 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:37:37.367400 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-418ec2bd-0d82-4b1b-921c-e33b12b7b5ab tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:37.368182 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-418ec2bd-0d82-4b1b-921c-e33b12b7b5ab tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] [instance: eef504a5-c89a-46d6-b032-3f78f265ed79] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:37.375590 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-418ec2bd-0d82-4b1b-921c-e33b12b7b5ab tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:37.376093 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-418ec2bd-0d82-4b1b-921c-e33b12b7b5ab tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:37.376916 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-418ec2bd-0d82-4b1b-921c-e33b12b7b5ab tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:37.377407 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-418ec2bd-0d82-4b1b-921c-e33b12b7b5ab tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:37.459548 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-418ec2bd-0d82-4b1b-921c-e33b12b7b5ab tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:37.459548 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-418ec2bd-0d82-4b1b-921c-e33b12b7b5ab tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:37.460461 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.objects.instance [None req-418ec2bd-0d82-4b1b-921c-e33b12b7b5ab tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lazy-loading 'fault' on Instance uuid eef504a5-c89a-46d6-b032-3f78f265ed79 {{(pid=98081) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:37:37.483543 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-c0561411-a671-4cce-be77-8f49d212c318 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "POST /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/action" status: 200 len: 14 microversion: 2.20 time: 2.981748 Feb 17 04:37:37.484657 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 82/179] 10.222.0.38 () {62 vars in 1309 bytes} [Wed Feb 17 04:37:34 2021] POST /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/action => generated 14 bytes in 2984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:37.492251 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-8f28cfd6-8943-4492-b450-e9825d766c2b tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:37.493315 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-8f28cfd6-8943-4492-b450-e9825d766c2b tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: 5d8fcb1f-fa8f-4a61-8e8b-77a64053ca3c] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:37.502910 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8f28cfd6-8943-4492-b450-e9825d766c2b tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:37.503421 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8f28cfd6-8943-4492-b450-e9825d766c2b tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:37.504269 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8f28cfd6-8943-4492-b450-e9825d766c2b tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:37.504761 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8f28cfd6-8943-4492-b450-e9825d766c2b tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:37.651914 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-418ec2bd-0d82-4b1b-921c-e33b12b7b5ab tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b74b528e2d4778a5f82cba65fcc178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c8bf81d567949c194eb63efc45f5bdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:37.663424 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-418ec2bd-0d82-4b1b-921c-e33b12b7b5ab tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] 10.222.0.38 "GET /compute/v2.1/servers/eef504a5-c89a-46d6-b032-3f78f265ed79" status: 200 len: 1350 microversion: 2.1 time: 0.299885 Feb 17 04:37:37.664243 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 98/180] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:37 2021] GET /compute/v2.1/servers/eef504a5-c89a-46d6-b032-3f78f265ed79 => generated 1350 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:37.671115 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-8f28cfd6-8943-4492-b450-e9825d766c2b tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a46d18160148f3a48ef4887f6ec7da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6284f2b80524eb0a36ccebaedba767a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:37.684807 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-8f28cfd6-8943-4492-b450-e9825d766c2b tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "GET /compute/v2.1/servers/5d8fcb1f-fa8f-4a61-8e8b-77a64053ca3c" status: 200 len: 1278 microversion: 2.1 time: 0.197918 Feb 17 04:37:37.685551 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 83/181] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:37 2021] GET /compute/v2.1/servers/5d8fcb1f-fa8f-4a61-8e8b-77a64053ca3c => generated 1278 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:38.380025 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-65827754-28c7-4d84-8d64-396a835b3160 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:38.380727 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-65827754-28c7-4d84-8d64-396a835b3160 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 1c099afc-d941-4044-83cc-39185d6d57b0] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:38.389155 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-65827754-28c7-4d84-8d64-396a835b3160 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:38.389664 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-65827754-28c7-4d84-8d64-396a835b3160 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:38.390496 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-65827754-28c7-4d84-8d64-396a835b3160 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:38.391023 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-65827754-28c7-4d84-8d64-396a835b3160 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:38.496502 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-dc4efeba-c97f-4395-986f-4f7e814045e8 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:37:38.497550 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-dc4efeba-c97f-4395-986f-4f7e814045e8 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:38.506684 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-dc4efeba-c97f-4395-986f-4f7e814045e8 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:38.507131 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-dc4efeba-c97f-4395-986f-4f7e814045e8 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:38.507993 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-dc4efeba-c97f-4395-986f-4f7e814045e8 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:38.508487 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-dc4efeba-c97f-4395-986f-4f7e814045e8 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:38.620264 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-dc4efeba-c97f-4395-986f-4f7e814045e8 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "POST /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/action" status: 200 len: 14 microversion: 2.20 time: 0.127532 Feb 17 04:37:38.623817 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 84/182] 10.222.0.38 () {62 vars in 1309 bytes} [Wed Feb 17 04:37:38 2021] POST /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/action => generated 14 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:38.688237 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-43387855-4ea5-447f-a160-46930fce1816 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:38.689334 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-43387855-4ea5-447f-a160-46930fce1816 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] [instance: eef504a5-c89a-46d6-b032-3f78f265ed79] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:38.699670 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-43387855-4ea5-447f-a160-46930fce1816 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:38.700406 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-43387855-4ea5-447f-a160-46930fce1816 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:38.701430 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-43387855-4ea5-447f-a160-46930fce1816 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:38.702214 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-43387855-4ea5-447f-a160-46930fce1816 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:38.760424 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.wsgi [None req-43387855-4ea5-447f-a160-46930fce1816 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] HTTP exception thrown: Instance eef504a5-c89a-46d6-b032-3f78f265ed79 could not be found. Feb 17 04:37:38.761015 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-43387855-4ea5-447f-a160-46930fce1816 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Returning 404 to user: Instance eef504a5-c89a-46d6-b032-3f78f265ed79 could not be found. {{(pid=98080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:37:38.762016 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-43387855-4ea5-447f-a160-46930fce1816 tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] 10.222.0.38 "GET /compute/v2.1/servers/eef504a5-c89a-46d6-b032-3f78f265ed79" status: 404 len: 111 microversion: 2.1 time: 0.078665 Feb 17 04:37:38.762665 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 85/183] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:38 2021] GET /compute/v2.1/servers/eef504a5-c89a-46d6-b032-3f78f265ed79 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 17 04:37:38.767430 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-efa649ac-caa5-4a41-ad58-9cd457a94aa9 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:38.768096 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-efa649ac-caa5-4a41-ad58-9cd457a94aa9 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: 5d8fcb1f-fa8f-4a61-8e8b-77a64053ca3c] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:38.776528 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-efa649ac-caa5-4a41-ad58-9cd457a94aa9 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:38.777032 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-efa649ac-caa5-4a41-ad58-9cd457a94aa9 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:38.778047 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-efa649ac-caa5-4a41-ad58-9cd457a94aa9 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:38.778539 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-efa649ac-caa5-4a41-ad58-9cd457a94aa9 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:38.819621 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-65827754-28c7-4d84-8d64-396a835b3160 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:38.836167 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-65827754-28c7-4d84-8d64-396a835b3160 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0" status: 200 len: 1521 microversion: 2.1 time: 0.460149 Feb 17 04:37:38.837042 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 99/184] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:38 2021] GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0 => generated 1521 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:39.476734 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-efa649ac-caa5-4a41-ad58-9cd457a94aa9 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a46d18160148f3a48ef4887f6ec7da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6284f2b80524eb0a36ccebaedba767a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:39.487034 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-efa649ac-caa5-4a41-ad58-9cd457a94aa9 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "GET /compute/v2.1/servers/5d8fcb1f-fa8f-4a61-8e8b-77a64053ca3c" status: 200 len: 1318 microversion: 2.1 time: 0.723238 Feb 17 04:37:39.488992 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 86/185] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:38 2021] GET /compute/v2.1/servers/5d8fcb1f-fa8f-4a61-8e8b-77a64053ca3c => generated 1318 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:39.632890 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-56188e7e-f647-4772-90b7-97aa4b0d36c3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:37:39.634278 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-56188e7e-f647-4772-90b7-97aa4b0d36c3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:39.643124 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-56188e7e-f647-4772-90b7-97aa4b0d36c3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:39.643777 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-56188e7e-f647-4772-90b7-97aa4b0d36c3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:39.644983 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-56188e7e-f647-4772-90b7-97aa4b0d36c3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:39.645641 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-56188e7e-f647-4772-90b7-97aa4b0d36c3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:39.817525 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-56188e7e-f647-4772-90b7-97aa4b0d36c3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "POST /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/action" status: 200 len: 867 microversion: 2.20 time: 0.189183 Feb 17 04:37:39.821580 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 100/186] 10.222.0.38 () {62 vars in 1309 bytes} [Wed Feb 17 04:37:39 2021] POST /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/action => generated 867 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 04:37:39.853834 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-fd158cc2-9abe-43e1-b1f2-94f6700383c5 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:39.854855 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-fd158cc2-9abe-43e1-b1f2-94f6700383c5 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 1c099afc-d941-4044-83cc-39185d6d57b0] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:39.863276 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-fd158cc2-9abe-43e1-b1f2-94f6700383c5 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:39.864003 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-fd158cc2-9abe-43e1-b1f2-94f6700383c5 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:39.865099 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-fd158cc2-9abe-43e1-b1f2-94f6700383c5 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:39.865773 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-fd158cc2-9abe-43e1-b1f2-94f6700383c5 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:40.468579 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-fd158cc2-9abe-43e1-b1f2-94f6700383c5 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:40.481795 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-fd158cc2-9abe-43e1-b1f2-94f6700383c5 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0" status: 200 len: 1521 microversion: 2.1 time: 0.632197 Feb 17 04:37:40.484133 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 87/187] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:39 2021] GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0 => generated 1521 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:40.509663 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-ea5e999b-4f9b-40b8-9abf-bf95273cac16 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:40.511136 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-ea5e999b-4f9b-40b8-9abf-bf95273cac16 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: 5d8fcb1f-fa8f-4a61-8e8b-77a64053ca3c] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:40.521057 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ea5e999b-4f9b-40b8-9abf-bf95273cac16 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:40.522546 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ea5e999b-4f9b-40b8-9abf-bf95273cac16 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:40.523745 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ea5e999b-4f9b-40b8-9abf-bf95273cac16 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:40.524639 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ea5e999b-4f9b-40b8-9abf-bf95273cac16 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:40.632190 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-c21f64a6-5f2d-4679-ad8b-5de29ef0025e tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:40.632968 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-c21f64a6-5f2d-4679-ad8b-5de29ef0025e tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] [instance: eef504a5-c89a-46d6-b032-3f78f265ed79] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:40.641697 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c21f64a6-5f2d-4679-ad8b-5de29ef0025e tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:40.642354 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c21f64a6-5f2d-4679-ad8b-5de29ef0025e tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:40.643345 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c21f64a6-5f2d-4679-ad8b-5de29ef0025e tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:40.644040 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c21f64a6-5f2d-4679-ad8b-5de29ef0025e tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:40.706390 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.wsgi [None req-c21f64a6-5f2d-4679-ad8b-5de29ef0025e tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] HTTP exception thrown: Instance eef504a5-c89a-46d6-b032-3f78f265ed79 could not be found. Feb 17 04:37:40.709645 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-c21f64a6-5f2d-4679-ad8b-5de29ef0025e tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Returning 404 to user: Instance eef504a5-c89a-46d6-b032-3f78f265ed79 could not be found. {{(pid=98080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:37:40.710600 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-c21f64a6-5f2d-4679-ad8b-5de29ef0025e tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] 10.222.0.38 "DELETE /compute/v2.1/servers/eef504a5-c89a-46d6-b032-3f78f265ed79" status: 404 len: 111 microversion: 2.1 time: 0.082897 Feb 17 04:37:40.711263 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 88/188] 10.222.0.38 () {58 vars in 1229 bytes} [Wed Feb 17 04:37:40 2021] DELETE /compute/v2.1/servers/eef504a5-c89a-46d6-b032-3f78f265ed79 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:37:40.720085 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-a6738a63-a40f-40a1-bf4d-a8c4ad8cfaab tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:40.721008 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-a6738a63-a40f-40a1-bf4d-a8c4ad8cfaab tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] [instance: eef504a5-c89a-46d6-b032-3f78f265ed79] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:40.730764 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a6738a63-a40f-40a1-bf4d-a8c4ad8cfaab tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:40.731555 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a6738a63-a40f-40a1-bf4d-a8c4ad8cfaab tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:40.732974 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a6738a63-a40f-40a1-bf4d-a8c4ad8cfaab tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:40.733653 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a6738a63-a40f-40a1-bf4d-a8c4ad8cfaab tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:40.794470 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.wsgi [None req-a6738a63-a40f-40a1-bf4d-a8c4ad8cfaab tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] HTTP exception thrown: Instance eef504a5-c89a-46d6-b032-3f78f265ed79 could not be found. Feb 17 04:37:40.795331 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-a6738a63-a40f-40a1-bf4d-a8c4ad8cfaab tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] Returning 404 to user: Instance eef504a5-c89a-46d6-b032-3f78f265ed79 could not be found. {{(pid=98080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:37:40.796357 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-a6738a63-a40f-40a1-bf4d-a8c4ad8cfaab tempest-DeleteServersTestJSON-2032624358 tempest-DeleteServersTestJSON-2032624358-project] 10.222.0.38 "GET /compute/v2.1/servers/eef504a5-c89a-46d6-b032-3f78f265ed79" status: 404 len: 111 microversion: 2.1 time: 0.080262 Feb 17 04:37:40.797096 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 89/189] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:40 2021] GET /compute/v2.1/servers/eef504a5-c89a-46d6-b032-3f78f265ed79 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:37:40.836101 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-0db754b2-326e-4a0e-85fe-91ff1bfa61cd tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:37:40.837997 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-0db754b2-326e-4a0e-85fe-91ff1bfa61cd tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:40.848367 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0db754b2-326e-4a0e-85fe-91ff1bfa61cd tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:40.848937 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0db754b2-326e-4a0e-85fe-91ff1bfa61cd tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:40.850750 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0db754b2-326e-4a0e-85fe-91ff1bfa61cd tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:40.851258 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0db754b2-326e-4a0e-85fe-91ff1bfa61cd tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:41.015646 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-0db754b2-326e-4a0e-85fe-91ff1bfa61cd tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "POST /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/action" status: 200 len: 7357 microversion: 2.20 time: 0.185752 Feb 17 04:37:41.016487 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 90/190] 10.222.0.38 () {62 vars in 1309 bytes} [Wed Feb 17 04:37:40 2021] POST /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/action => generated 7357 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 04:37:41.090266 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [req-4273947e-14cc-43ae-b5d4-4f99dae6b285 req-0e87fef8-61a2-4f27-b258-eebca215f220 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d8fcb1f-fa8f-4a61-8e8b-77a64053ca3c", "tag": "c45cb327-88cb-4944-9e37-27538a1aa3b5"}]} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:37:41.092786 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:37:41.092786 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:37:41.123728 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-4273947e-14cc-43ae-b5d4-4f99dae6b285 req-0e87fef8-61a2-4f27-b258-eebca215f220 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:41.124240 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-4273947e-14cc-43ae-b5d4-4f99dae6b285 req-0e87fef8-61a2-4f27-b258-eebca215f220 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:41.145892 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.compute.server_external_events [req-4273947e-14cc-43ae-b5d4-4f99dae6b285 req-0e87fef8-61a2-4f27-b258-eebca215f220 service nova] Creating event network-changed:c45cb327-88cb-4944-9e37-27538a1aa3b5 for instance 5d8fcb1f-fa8f-4a61-8e8b-77a64053ca3c on hv-cinder-76019 Feb 17 04:37:41.152900 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [req-4273947e-14cc-43ae-b5d4-4f99dae6b285 req-0e87fef8-61a2-4f27-b258-eebca215f220 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068592 Feb 17 04:37:41.153946 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 91/191] 10.222.0.38 () {64 vars in 1308 bytes} [Wed Feb 17 04:37:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:37:41.211059 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-ea5e999b-4f9b-40b8-9abf-bf95273cac16 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a46d18160148f3a48ef4887f6ec7da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6284f2b80524eb0a36ccebaedba767a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:41.220212 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-ea5e999b-4f9b-40b8-9abf-bf95273cac16 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "GET /compute/v2.1/servers/5d8fcb1f-fa8f-4a61-8e8b-77a64053ca3c" status: 200 len: 1318 microversion: 2.1 time: 0.716502 Feb 17 04:37:41.221113 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 101/192] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:40 2021] GET /compute/v2.1/servers/5d8fcb1f-fa8f-4a61-8e8b-77a64053ca3c => generated 1318 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:41.505039 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-e8a7c6d9-1b8b-4db0-8673-7b3a608661e1 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:41.507867 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-e8a7c6d9-1b8b-4db0-8673-7b3a608661e1 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 1c099afc-d941-4044-83cc-39185d6d57b0] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:41.526507 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e8a7c6d9-1b8b-4db0-8673-7b3a608661e1 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:41.527051 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e8a7c6d9-1b8b-4db0-8673-7b3a608661e1 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:41.528297 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e8a7c6d9-1b8b-4db0-8673-7b3a608661e1 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:41.528687 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e8a7c6d9-1b8b-4db0-8673-7b3a608661e1 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:42.011751 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-e8a7c6d9-1b8b-4db0-8673-7b3a608661e1 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:42.031038 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-8dad3144-fb2f-4931-912b-40789197c7f1 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:37:42.032733 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-8dad3144-fb2f-4931-912b-40789197c7f1 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:42.044391 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-e8a7c6d9-1b8b-4db0-8673-7b3a608661e1 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0" status: 200 len: 1521 microversion: 2.1 time: 0.546584 Feb 17 04:37:42.050928 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 92/193] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:41 2021] GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0 => generated 1521 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:42.061738 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8dad3144-fb2f-4931-912b-40789197c7f1 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:42.061738 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8dad3144-fb2f-4931-912b-40789197c7f1 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:42.061738 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8dad3144-fb2f-4931-912b-40789197c7f1 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:42.061738 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8dad3144-fb2f-4931-912b-40789197c7f1 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:42.219882 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-8dad3144-fb2f-4931-912b-40789197c7f1 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "POST /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/action" status: 200 len: 11491 microversion: 2.20 time: 0.195217 Feb 17 04:37:42.220755 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 102/194] 10.222.0.38 () {62 vars in 1309 bytes} [Wed Feb 17 04:37:42 2021] POST /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/action => generated 11491 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:37:42.243191 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-8f248302-8f8e-4b20-81fd-30914ea61911 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:42.244280 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-8f248302-8f8e-4b20-81fd-30914ea61911 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: 5d8fcb1f-fa8f-4a61-8e8b-77a64053ca3c] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:42.256715 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8f248302-8f8e-4b20-81fd-30914ea61911 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:42.257549 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8f248302-8f8e-4b20-81fd-30914ea61911 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:42.259131 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8f248302-8f8e-4b20-81fd-30914ea61911 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:42.259846 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8f248302-8f8e-4b20-81fd-30914ea61911 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:42.720568 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-8f248302-8f8e-4b20-81fd-30914ea61911 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a46d18160148f3a48ef4887f6ec7da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6284f2b80524eb0a36ccebaedba767a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:42.731035 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-8f248302-8f8e-4b20-81fd-30914ea61911 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "GET /compute/v2.1/servers/5d8fcb1f-fa8f-4a61-8e8b-77a64053ca3c" status: 200 len: 1318 microversion: 2.1 time: 0.493627 Feb 17 04:37:42.731758 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 93/195] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:42 2021] GET /compute/v2.1/servers/5d8fcb1f-fa8f-4a61-8e8b-77a64053ca3c => generated 1318 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:43.070278 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-24334d25-3edf-4f59-885d-0c2ed95e08dc tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:43.071595 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-24334d25-3edf-4f59-885d-0c2ed95e08dc tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 1c099afc-d941-4044-83cc-39185d6d57b0] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:43.082646 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-24334d25-3edf-4f59-885d-0c2ed95e08dc tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:43.083403 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-24334d25-3edf-4f59-885d-0c2ed95e08dc tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:43.085271 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-24334d25-3edf-4f59-885d-0c2ed95e08dc tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:43.085992 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-24334d25-3edf-4f59-885d-0c2ed95e08dc tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:43.232705 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-0c08ceb3-ac5d-4728-8d2e-3a928baa815c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:37:43.233993 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-0c08ceb3-ac5d-4728-8d2e-3a928baa815c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:43.248801 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0c08ceb3-ac5d-4728-8d2e-3a928baa815c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:43.250404 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0c08ceb3-ac5d-4728-8d2e-3a928baa815c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:43.252770 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0c08ceb3-ac5d-4728-8d2e-3a928baa815c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:43.254674 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0c08ceb3-ac5d-4728-8d2e-3a928baa815c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:43.424762 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-0c08ceb3-ac5d-4728-8d2e-3a928baa815c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "POST /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/action" status: 200 len: 15064 microversion: 2.20 time: 0.196129 Feb 17 04:37:43.425825 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 94/196] 10.222.0.38 () {62 vars in 1309 bytes} [Wed Feb 17 04:37:43 2021] POST /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/action => generated 15064 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:37:43.507682 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-24334d25-3edf-4f59-885d-0c2ed95e08dc tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:43.518035 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-24334d25-3edf-4f59-885d-0c2ed95e08dc tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0" status: 200 len: 1521 microversion: 2.1 time: 0.453756 Feb 17 04:37:43.519394 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 103/197] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:43 2021] GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0 => generated 1521 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:43.751025 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-57416f38-1288-47b8-8ee0-ee92ec1c5d40 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:43.751881 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-57416f38-1288-47b8-8ee0-ee92ec1c5d40 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: 5d8fcb1f-fa8f-4a61-8e8b-77a64053ca3c] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:43.762008 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-57416f38-1288-47b8-8ee0-ee92ec1c5d40 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:43.762663 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-57416f38-1288-47b8-8ee0-ee92ec1c5d40 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:43.763595 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-57416f38-1288-47b8-8ee0-ee92ec1c5d40 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:43.764625 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-57416f38-1288-47b8-8ee0-ee92ec1c5d40 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:44.045272 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-57416f38-1288-47b8-8ee0-ee92ec1c5d40 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a46d18160148f3a48ef4887f6ec7da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6284f2b80524eb0a36ccebaedba767a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:44.055445 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-57416f38-1288-47b8-8ee0-ee92ec1c5d40 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "GET /compute/v2.1/servers/5d8fcb1f-fa8f-4a61-8e8b-77a64053ca3c" status: 200 len: 1318 microversion: 2.1 time: 0.309070 Feb 17 04:37:44.056379 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 95/198] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:43 2021] GET /compute/v2.1/servers/5d8fcb1f-fa8f-4a61-8e8b-77a64053ca3c => generated 1318 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:44.437994 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-a33d9f88-39ce-4694-9497-83bd5e65a85a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:37:44.439503 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-a33d9f88-39ce-4694-9497-83bd5e65a85a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:44.449664 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a33d9f88-39ce-4694-9497-83bd5e65a85a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:44.450152 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a33d9f88-39ce-4694-9497-83bd5e65a85a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:44.451226 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a33d9f88-39ce-4694-9497-83bd5e65a85a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:44.451932 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a33d9f88-39ce-4694-9497-83bd5e65a85a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:44.537581 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-1f1fa49e-5ba6-4429-ae00-e458919259dc tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:44.538612 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-1f1fa49e-5ba6-4429-ae00-e458919259dc tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 1c099afc-d941-4044-83cc-39185d6d57b0] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:44.547261 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1f1fa49e-5ba6-4429-ae00-e458919259dc tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:44.547889 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1f1fa49e-5ba6-4429-ae00-e458919259dc tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:44.548865 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1f1fa49e-5ba6-4429-ae00-e458919259dc tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:44.549490 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1f1fa49e-5ba6-4429-ae00-e458919259dc tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:44.595987 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-a33d9f88-39ce-4694-9497-83bd5e65a85a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "POST /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/action" status: 200 len: 17861 microversion: 2.20 time: 0.162743 Feb 17 04:37:44.599575 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 104/199] 10.222.0.38 () {62 vars in 1309 bytes} [Wed Feb 17 04:37:44 2021] POST /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/action => generated 17861 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:37:44.794840 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-1f1fa49e-5ba6-4429-ae00-e458919259dc tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:44.805928 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-1f1fa49e-5ba6-4429-ae00-e458919259dc tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0" status: 200 len: 1521 microversion: 2.1 time: 0.272968 Feb 17 04:37:44.806583 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 96/200] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:44 2021] GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0 => generated 1521 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:45.076431 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-b5902d2f-6768-4fa9-894a-c52d857ab22f tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:45.077554 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-b5902d2f-6768-4fa9-894a-c52d857ab22f tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: 5d8fcb1f-fa8f-4a61-8e8b-77a64053ca3c] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:45.088245 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b5902d2f-6768-4fa9-894a-c52d857ab22f tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:45.088752 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b5902d2f-6768-4fa9-894a-c52d857ab22f tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:45.089603 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b5902d2f-6768-4fa9-894a-c52d857ab22f tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:45.090095 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b5902d2f-6768-4fa9-894a-c52d857ab22f tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:45.332824 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-b5902d2f-6768-4fa9-894a-c52d857ab22f tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a46d18160148f3a48ef4887f6ec7da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6284f2b80524eb0a36ccebaedba767a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:45.351932 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-b5902d2f-6768-4fa9-894a-c52d857ab22f tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "GET /compute/v2.1/servers/5d8fcb1f-fa8f-4a61-8e8b-77a64053ca3c" status: 200 len: 1318 microversion: 2.1 time: 0.280638 Feb 17 04:37:45.352962 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 105/201] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:45 2021] GET /compute/v2.1/servers/5d8fcb1f-fa8f-4a61-8e8b-77a64053ca3c => generated 1318 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:45.608180 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-252c401e-b26b-4167-8484-377b5714c9fb tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:37:45.609497 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-252c401e-b26b-4167-8484-377b5714c9fb tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:45.617318 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-252c401e-b26b-4167-8484-377b5714c9fb tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:45.617834 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-252c401e-b26b-4167-8484-377b5714c9fb tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:45.618727 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-252c401e-b26b-4167-8484-377b5714c9fb tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:45.619208 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-252c401e-b26b-4167-8484-377b5714c9fb tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:45.764937 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-252c401e-b26b-4167-8484-377b5714c9fb tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "POST /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/action" status: 200 len: 18013 microversion: 2.20 time: 0.160685 Feb 17 04:37:45.765460 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 97/202] 10.222.0.38 () {62 vars in 1309 bytes} [Wed Feb 17 04:37:45 2021] POST /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/action => generated 18013 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:37:45.824697 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-055b4ba4-bad2-4011-9bcc-d53e7f5279ca tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:45.825380 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-055b4ba4-bad2-4011-9bcc-d53e7f5279ca tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 1c099afc-d941-4044-83cc-39185d6d57b0] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:45.834300 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-055b4ba4-bad2-4011-9bcc-d53e7f5279ca tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:45.835058 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-055b4ba4-bad2-4011-9bcc-d53e7f5279ca tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:45.836076 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-055b4ba4-bad2-4011-9bcc-d53e7f5279ca tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:45.836726 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-055b4ba4-bad2-4011-9bcc-d53e7f5279ca tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:46.117471 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-055b4ba4-bad2-4011-9bcc-d53e7f5279ca tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:46.126746 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-055b4ba4-bad2-4011-9bcc-d53e7f5279ca tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0" status: 200 len: 1521 microversion: 2.1 time: 0.306086 Feb 17 04:37:46.127334 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 106/203] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:45 2021] GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0 => generated 1521 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:46.370426 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-03ed451c-3eb3-4cff-b70c-8b46d2f22832 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:46.371443 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-03ed451c-3eb3-4cff-b70c-8b46d2f22832 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: 5d8fcb1f-fa8f-4a61-8e8b-77a64053ca3c] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:46.382936 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-03ed451c-3eb3-4cff-b70c-8b46d2f22832 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:46.383649 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-03ed451c-3eb3-4cff-b70c-8b46d2f22832 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:46.384930 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-03ed451c-3eb3-4cff-b70c-8b46d2f22832 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:46.385659 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-03ed451c-3eb3-4cff-b70c-8b46d2f22832 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:46.598325 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-42d8bcca-984e-4482-be05-0c523bdeb164 tempest-VolumesTestJSON-1986660052 tempest-VolumesTestJSON-1986660052-project] Calling method '.version_select at 0x7fc2ea010a60>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:46.703751 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-03ed451c-3eb3-4cff-b70c-8b46d2f22832 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a46d18160148f3a48ef4887f6ec7da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6284f2b80524eb0a36ccebaedba767a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:46.705988 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-42d8bcca-984e-4482-be05-0c523bdeb164 tempest-VolumesTestJSON-1986660052 tempest-VolumesTestJSON-1986660052-project] 10.222.0.38 "GET /compute/v2.1/os-volumes/5063c40f-76c3-43aa-b992-e1fa2d25dd55" status: 200 len: 350 microversion: 2.1 time: 0.112138 Feb 17 04:37:46.706700 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 107/204] 10.222.0.38 () {58 vars in 1235 bytes} [Wed Feb 17 04:37:46 2021] GET /compute/v2.1/os-volumes/5063c40f-76c3-43aa-b992-e1fa2d25dd55 => generated 350 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:37:46.713132 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-03ed451c-3eb3-4cff-b70c-8b46d2f22832 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "GET /compute/v2.1/servers/5d8fcb1f-fa8f-4a61-8e8b-77a64053ca3c" status: 200 len: 1318 microversion: 2.1 time: 0.347151 Feb 17 04:37:46.713713 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 98/205] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:46 2021] GET /compute/v2.1/servers/5d8fcb1f-fa8f-4a61-8e8b-77a64053ca3c => generated 1318 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:46.777745 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-e3194213-cabd-4a2b-a9e6-f2fc38170111 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:37:46.778777 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-e3194213-cabd-4a2b-a9e6-f2fc38170111 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:46.788324 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e3194213-cabd-4a2b-a9e6-f2fc38170111 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:46.789222 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e3194213-cabd-4a2b-a9e6-f2fc38170111 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:46.790272 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e3194213-cabd-4a2b-a9e6-f2fc38170111 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:46.790944 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e3194213-cabd-4a2b-a9e6-f2fc38170111 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:47.145057 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-ff5c94c3-3408-4f62-bbee-f8bb268af659 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:47.147166 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-ff5c94c3-3408-4f62-bbee-f8bb268af659 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 1c099afc-d941-4044-83cc-39185d6d57b0] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:47.156295 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ff5c94c3-3408-4f62-bbee-f8bb268af659 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:47.157025 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ff5c94c3-3408-4f62-bbee-f8bb268af659 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:47.158212 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ff5c94c3-3408-4f62-bbee-f8bb268af659 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:47.159208 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ff5c94c3-3408-4f62-bbee-f8bb268af659 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:47.385939 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-ff5c94c3-3408-4f62-bbee-f8bb268af659 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:47.395108 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-ff5c94c3-3408-4f62-bbee-f8bb268af659 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0" status: 200 len: 1521 microversion: 2.1 time: 0.253881 Feb 17 04:37:47.395696 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 99/206] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:47 2021] GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0 => generated 1521 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:47.731280 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-1cde06e1-54a8-495a-964f-32e0fe6b1b0e tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:47.732159 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-1cde06e1-54a8-495a-964f-32e0fe6b1b0e tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: 5d8fcb1f-fa8f-4a61-8e8b-77a64053ca3c] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:47.744558 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1cde06e1-54a8-495a-964f-32e0fe6b1b0e tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:47.745077 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1cde06e1-54a8-495a-964f-32e0fe6b1b0e tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:47.745908 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1cde06e1-54a8-495a-964f-32e0fe6b1b0e tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:47.746649 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1cde06e1-54a8-495a-964f-32e0fe6b1b0e tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:47.976847 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-1cde06e1-54a8-495a-964f-32e0fe6b1b0e tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a46d18160148f3a48ef4887f6ec7da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6284f2b80524eb0a36ccebaedba767a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:47.986306 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-1cde06e1-54a8-495a-964f-32e0fe6b1b0e tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "GET /compute/v2.1/servers/5d8fcb1f-fa8f-4a61-8e8b-77a64053ca3c" status: 200 len: 1318 microversion: 2.1 time: 0.259009 Feb 17 04:37:47.986957 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 100/207] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:47 2021] GET /compute/v2.1/servers/5d8fcb1f-fa8f-4a61-8e8b-77a64053ca3c => generated 1318 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:37:48.413810 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-84d7130c-cf9f-48a5-9ddd-e37615e2e5e0 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:48.414492 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-84d7130c-cf9f-48a5-9ddd-e37615e2e5e0 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 1c099afc-d941-4044-83cc-39185d6d57b0] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:48.423357 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-84d7130c-cf9f-48a5-9ddd-e37615e2e5e0 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:48.423858 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-84d7130c-cf9f-48a5-9ddd-e37615e2e5e0 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:48.424968 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-84d7130c-cf9f-48a5-9ddd-e37615e2e5e0 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:48.425644 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-84d7130c-cf9f-48a5-9ddd-e37615e2e5e0 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:48.639165 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-84d7130c-cf9f-48a5-9ddd-e37615e2e5e0 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:48.648560 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-84d7130c-cf9f-48a5-9ddd-e37615e2e5e0 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0" status: 200 len: 1521 microversion: 2.1 time: 0.239019 Feb 17 04:37:48.649147 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 101/208] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:48 2021] GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0 => generated 1521 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:37:49.003736 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-0b97e29f-fcae-4dc0-b7cb-bad2fd3db2de tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:49.004408 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-0b97e29f-fcae-4dc0-b7cb-bad2fd3db2de tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: 5d8fcb1f-fa8f-4a61-8e8b-77a64053ca3c] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:49.013004 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0b97e29f-fcae-4dc0-b7cb-bad2fd3db2de tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:49.013509 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0b97e29f-fcae-4dc0-b7cb-bad2fd3db2de tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:49.014339 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0b97e29f-fcae-4dc0-b7cb-bad2fd3db2de tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:49.014856 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0b97e29f-fcae-4dc0-b7cb-bad2fd3db2de tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:49.049297 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-e3194213-cabd-4a2b-a9e6-f2fc38170111 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "POST /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/action" status: 200 len: 21966 microversion: 2.20 time: 2.275275 Feb 17 04:37:49.050003 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 108/209] 10.222.0.38 () {62 vars in 1309 bytes} [Wed Feb 17 04:37:46 2021] POST /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/action => generated 21966 bytes in 2277 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:37:49.238167 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-0b97e29f-fcae-4dc0-b7cb-bad2fd3db2de tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a46d18160148f3a48ef4887f6ec7da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6284f2b80524eb0a36ccebaedba767a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:49.247553 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-0b97e29f-fcae-4dc0-b7cb-bad2fd3db2de tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "GET /compute/v2.1/servers/5d8fcb1f-fa8f-4a61-8e8b-77a64053ca3c" status: 200 len: 1318 microversion: 2.1 time: 0.247811 Feb 17 04:37:49.248317 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 102/210] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:48 2021] GET /compute/v2.1/servers/5d8fcb1f-fa8f-4a61-8e8b-77a64053ca3c => generated 1318 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:37:49.475519 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [req-249685af-c8a5-451b-a237-b8ad2b79ca06 req-b9e233df-28a3-42ab-8cec-014ee9c39c91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d8fcb1f-fa8f-4a61-8e8b-77a64053ca3c", "name": "network-vif-plugged", "status": "completed", "tag": "c45cb327-88cb-4944-9e37-27538a1aa3b5"}]} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:37:49.477366 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:37:49.477366 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:37:49.487609 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-249685af-c8a5-451b-a237-b8ad2b79ca06 req-b9e233df-28a3-42ab-8cec-014ee9c39c91 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:49.488113 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-249685af-c8a5-451b-a237-b8ad2b79ca06 req-b9e233df-28a3-42ab-8cec-014ee9c39c91 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:49.509029 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.compute.server_external_events [req-249685af-c8a5-451b-a237-b8ad2b79ca06 req-b9e233df-28a3-42ab-8cec-014ee9c39c91 service nova] Creating event network-vif-plugged:c45cb327-88cb-4944-9e37-27538a1aa3b5 for instance 5d8fcb1f-fa8f-4a61-8e8b-77a64053ca3c on hv-cinder-76019 Feb 17 04:37:49.514168 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [req-249685af-c8a5-451b-a237-b8ad2b79ca06 req-b9e233df-28a3-42ab-8cec-014ee9c39c91 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044019 Feb 17 04:37:49.514906 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 109/211] 10.222.0.38 () {64 vars in 1308 bytes} [Wed Feb 17 04:37:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:37:49.668019 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-a4c90aa6-b366-4aa8-ac9e-577b5c7db645 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:49.668708 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-a4c90aa6-b366-4aa8-ac9e-577b5c7db645 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 1c099afc-d941-4044-83cc-39185d6d57b0] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:49.677037 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a4c90aa6-b366-4aa8-ac9e-577b5c7db645 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:49.678690 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a4c90aa6-b366-4aa8-ac9e-577b5c7db645 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:49.679548 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a4c90aa6-b366-4aa8-ac9e-577b5c7db645 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:49.680048 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a4c90aa6-b366-4aa8-ac9e-577b5c7db645 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:49.902138 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-a4c90aa6-b366-4aa8-ac9e-577b5c7db645 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:49.912435 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-a4c90aa6-b366-4aa8-ac9e-577b5c7db645 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0" status: 200 len: 1521 microversion: 2.1 time: 0.247663 Feb 17 04:37:49.913137 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 103/212] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:49 2021] GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0 => generated 1521 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:50.064138 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-1ab343ba-6148-4585-b458-f2a267961e12 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:37:50.065289 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-1ab343ba-6148-4585-b458-f2a267961e12 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:50.075723 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1ab343ba-6148-4585-b458-f2a267961e12 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:50.076232 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1ab343ba-6148-4585-b458-f2a267961e12 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:50.077082 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1ab343ba-6148-4585-b458-f2a267961e12 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:50.077573 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1ab343ba-6148-4585-b458-f2a267961e12 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:50.265381 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-e1aa508e-515d-43c8-8559-e11cc2f9b660 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:50.266114 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-e1aa508e-515d-43c8-8559-e11cc2f9b660 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: 5d8fcb1f-fa8f-4a61-8e8b-77a64053ca3c] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:50.275124 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e1aa508e-515d-43c8-8559-e11cc2f9b660 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:50.275636 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e1aa508e-515d-43c8-8559-e11cc2f9b660 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:50.276563 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e1aa508e-515d-43c8-8559-e11cc2f9b660 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:50.277058 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e1aa508e-515d-43c8-8559-e11cc2f9b660 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:50.495517 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-e1aa508e-515d-43c8-8559-e11cc2f9b660 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a46d18160148f3a48ef4887f6ec7da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6284f2b80524eb0a36ccebaedba767a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:50.504512 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-e1aa508e-515d-43c8-8559-e11cc2f9b660 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "GET /compute/v2.1/servers/5d8fcb1f-fa8f-4a61-8e8b-77a64053ca3c" status: 200 len: 1318 microversion: 2.1 time: 0.243039 Feb 17 04:37:50.505088 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 104/213] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:50 2021] GET /compute/v2.1/servers/5d8fcb1f-fa8f-4a61-8e8b-77a64053ca3c => generated 1318 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:50.930733 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-287f136c-cba2-4753-a3d8-ce44f64d2da8 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:50.931399 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-287f136c-cba2-4753-a3d8-ce44f64d2da8 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 1c099afc-d941-4044-83cc-39185d6d57b0] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:50.939456 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-287f136c-cba2-4753-a3d8-ce44f64d2da8 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:50.939960 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-287f136c-cba2-4753-a3d8-ce44f64d2da8 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:50.940783 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-287f136c-cba2-4753-a3d8-ce44f64d2da8 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:50.941267 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-287f136c-cba2-4753-a3d8-ce44f64d2da8 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:51.155386 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-287f136c-cba2-4753-a3d8-ce44f64d2da8 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:51.165362 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-287f136c-cba2-4753-a3d8-ce44f64d2da8 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0" status: 200 len: 1521 microversion: 2.1 time: 0.238988 Feb 17 04:37:51.165959 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 105/214] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:50 2021] GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0 => generated 1521 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:37:51.522790 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-bc03cf22-b45b-4f2f-9997-36b9e447f22b tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:51.523466 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-bc03cf22-b45b-4f2f-9997-36b9e447f22b tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: 5d8fcb1f-fa8f-4a61-8e8b-77a64053ca3c] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:51.531401 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-bc03cf22-b45b-4f2f-9997-36b9e447f22b tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:51.532149 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-bc03cf22-b45b-4f2f-9997-36b9e447f22b tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:51.533063 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-bc03cf22-b45b-4f2f-9997-36b9e447f22b tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:51.533562 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-bc03cf22-b45b-4f2f-9997-36b9e447f22b tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:51.748917 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-bc03cf22-b45b-4f2f-9997-36b9e447f22b tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a46d18160148f3a48ef4887f6ec7da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6284f2b80524eb0a36ccebaedba767a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:51.758189 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-bc03cf22-b45b-4f2f-9997-36b9e447f22b tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "GET /compute/v2.1/servers/5d8fcb1f-fa8f-4a61-8e8b-77a64053ca3c" status: 200 len: 1318 microversion: 2.1 time: 0.240770 Feb 17 04:37:51.758809 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 106/215] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:51 2021] GET /compute/v2.1/servers/5d8fcb1f-fa8f-4a61-8e8b-77a64053ca3c => generated 1318 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:52.183606 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-2d76be70-dc7f-4164-91f7-e8736d16fa23 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:52.184523 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-2d76be70-dc7f-4164-91f7-e8736d16fa23 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 1c099afc-d941-4044-83cc-39185d6d57b0] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:52.192221 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2d76be70-dc7f-4164-91f7-e8736d16fa23 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:52.193418 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2d76be70-dc7f-4164-91f7-e8736d16fa23 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:52.194253 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2d76be70-dc7f-4164-91f7-e8736d16fa23 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:52.194823 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2d76be70-dc7f-4164-91f7-e8736d16fa23 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:52.400142 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-2d76be70-dc7f-4164-91f7-e8736d16fa23 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:52.409299 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-2d76be70-dc7f-4164-91f7-e8736d16fa23 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0" status: 200 len: 1521 microversion: 2.1 time: 0.229569 Feb 17 04:37:52.409901 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 107/216] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:52 2021] GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0 => generated 1521 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:52.543775 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-1ab343ba-6148-4585-b458-f2a267961e12 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "POST /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/action" status: 200 len: 26381 microversion: 2.20 time: 2.484434 Feb 17 04:37:52.545209 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 110/217] 10.222.0.38 () {62 vars in 1309 bytes} [Wed Feb 17 04:37:50 2021] POST /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/action => generated 26381 bytes in 2487 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:37:52.776446 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-f7988403-19ec-461d-add6-4adcfeb93912 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:52.777118 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-f7988403-19ec-461d-add6-4adcfeb93912 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: 5d8fcb1f-fa8f-4a61-8e8b-77a64053ca3c] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:52.784919 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f7988403-19ec-461d-add6-4adcfeb93912 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:52.785432 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f7988403-19ec-461d-add6-4adcfeb93912 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:52.786794 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f7988403-19ec-461d-add6-4adcfeb93912 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:52.787752 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f7988403-19ec-461d-add6-4adcfeb93912 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:53.007538 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-f7988403-19ec-461d-add6-4adcfeb93912 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a46d18160148f3a48ef4887f6ec7da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6284f2b80524eb0a36ccebaedba767a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:53.016647 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-f7988403-19ec-461d-add6-4adcfeb93912 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "GET /compute/v2.1/servers/5d8fcb1f-fa8f-4a61-8e8b-77a64053ca3c" status: 200 len: 1318 microversion: 2.1 time: 0.244201 Feb 17 04:37:53.017257 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 108/218] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:52 2021] GET /compute/v2.1/servers/5d8fcb1f-fa8f-4a61-8e8b-77a64053ca3c => generated 1318 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:53.428598 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-9dbe5d98-f089-4f80-acf5-ebbe26b324f9 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:53.429284 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-9dbe5d98-f089-4f80-acf5-ebbe26b324f9 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 1c099afc-d941-4044-83cc-39185d6d57b0] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:53.438105 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9dbe5d98-f089-4f80-acf5-ebbe26b324f9 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:53.438636 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9dbe5d98-f089-4f80-acf5-ebbe26b324f9 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:53.439474 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9dbe5d98-f089-4f80-acf5-ebbe26b324f9 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:53.439966 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9dbe5d98-f089-4f80-acf5-ebbe26b324f9 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:53.557839 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-55b0d6b0-ed97-4f4a-ae35-2c49433d5f73 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:37:53.560154 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-55b0d6b0-ed97-4f4a-ae35-2c49433d5f73 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:53.570514 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-55b0d6b0-ed97-4f4a-ae35-2c49433d5f73 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:53.571118 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-55b0d6b0-ed97-4f4a-ae35-2c49433d5f73 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:53.574275 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-55b0d6b0-ed97-4f4a-ae35-2c49433d5f73 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:53.574275 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-55b0d6b0-ed97-4f4a-ae35-2c49433d5f73 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:53.693610 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-9dbe5d98-f089-4f80-acf5-ebbe26b324f9 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:53.702470 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-9dbe5d98-f089-4f80-acf5-ebbe26b324f9 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0" status: 200 len: 1521 microversion: 2.1 time: 0.279173 Feb 17 04:37:53.703093 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 111/219] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:53 2021] GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0 => generated 1521 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:53.730759 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-55b0d6b0-ed97-4f4a-ae35-2c49433d5f73 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "POST /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/action" status: 200 len: 26895 microversion: 2.20 time: 0.177171 Feb 17 04:37:53.731583 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 109/220] 10.222.0.38 () {62 vars in 1309 bytes} [Wed Feb 17 04:37:53 2021] POST /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/action => generated 26895 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 04:37:53.816982 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-d8f3a429-a2f4-4ba2-873b-88ce29fd8124 tempest-VolumesTestJSON-1986660052 tempest-VolumesTestJSON-1986660052-project] Calling method '.version_select at 0x7fc2ea8e8510>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:53.920308 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-d8f3a429-a2f4-4ba2-873b-88ce29fd8124 tempest-VolumesTestJSON-1986660052 tempest-VolumesTestJSON-1986660052-project] 10.222.0.38 "GET /compute/v2.1/os-volumes/a923c3fa-3337-4b43-87ab-7cdfbd609ea9" status: 200 len: 351 microversion: 2.1 time: 0.107192 Feb 17 04:37:53.921027 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 112/221] 10.222.0.38 () {58 vars in 1235 bytes} [Wed Feb 17 04:37:53 2021] GET /compute/v2.1/os-volumes/a923c3fa-3337-4b43-87ab-7cdfbd609ea9 => generated 351 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:37:54.036497 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-8aa0444d-6a23-430b-8e4b-f81c71e30f95 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:54.037621 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-8aa0444d-6a23-430b-8e4b-f81c71e30f95 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: 5d8fcb1f-fa8f-4a61-8e8b-77a64053ca3c] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:54.046940 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8aa0444d-6a23-430b-8e4b-f81c71e30f95 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:54.047584 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8aa0444d-6a23-430b-8e4b-f81c71e30f95 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:54.048551 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8aa0444d-6a23-430b-8e4b-f81c71e30f95 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:54.049165 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8aa0444d-6a23-430b-8e4b-f81c71e30f95 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:54.299749 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-8aa0444d-6a23-430b-8e4b-f81c71e30f95 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a46d18160148f3a48ef4887f6ec7da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6284f2b80524eb0a36ccebaedba767a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:54.311546 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-8aa0444d-6a23-430b-8e4b-f81c71e30f95 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "GET /compute/v2.1/servers/5d8fcb1f-fa8f-4a61-8e8b-77a64053ca3c" status: 200 len: 1318 microversion: 2.1 time: 0.279649 Feb 17 04:37:54.312689 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 110/222] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:54 2021] GET /compute/v2.1/servers/5d8fcb1f-fa8f-4a61-8e8b-77a64053ca3c => generated 1318 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:54.721692 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-7bc89a11-ba1c-4e24-8cff-4eb8215b7f9b tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:54.722259 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-7bc89a11-ba1c-4e24-8cff-4eb8215b7f9b tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 1c099afc-d941-4044-83cc-39185d6d57b0] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:54.731458 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7bc89a11-ba1c-4e24-8cff-4eb8215b7f9b tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:54.731968 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7bc89a11-ba1c-4e24-8cff-4eb8215b7f9b tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:54.732822 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7bc89a11-ba1c-4e24-8cff-4eb8215b7f9b tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:54.733319 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7bc89a11-ba1c-4e24-8cff-4eb8215b7f9b tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:54.745638 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-244d1207-0d0f-4d63-b31d-cdb627ea06ae tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:37:54.747123 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-244d1207-0d0f-4d63-b31d-cdb627ea06ae tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:54.756595 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-244d1207-0d0f-4d63-b31d-cdb627ea06ae tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:54.757307 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-244d1207-0d0f-4d63-b31d-cdb627ea06ae tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:54.758305 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-244d1207-0d0f-4d63-b31d-cdb627ea06ae tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:54.759524 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-244d1207-0d0f-4d63-b31d-cdb627ea06ae tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:54.900325 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-244d1207-0d0f-4d63-b31d-cdb627ea06ae tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "POST /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/action" status: 200 len: 27290 microversion: 2.20 time: 0.160369 Feb 17 04:37:54.901624 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 111/223] 10.222.0.38 () {62 vars in 1309 bytes} [Wed Feb 17 04:37:54 2021] POST /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/action => generated 27290 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 04:37:54.971540 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-7bc89a11-ba1c-4e24-8cff-4eb8215b7f9b tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:54.980413 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-7bc89a11-ba1c-4e24-8cff-4eb8215b7f9b tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0" status: 200 len: 1521 microversion: 2.1 time: 0.263185 Feb 17 04:37:54.981207 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 113/224] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:54 2021] GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0 => generated 1521 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:55.333559 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-7f654aa6-543c-42c5-be56-d14ee0c73cd0 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:55.334604 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-7f654aa6-543c-42c5-be56-d14ee0c73cd0 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: 5d8fcb1f-fa8f-4a61-8e8b-77a64053ca3c] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:55.346786 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7f654aa6-543c-42c5-be56-d14ee0c73cd0 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:55.347633 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7f654aa6-543c-42c5-be56-d14ee0c73cd0 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:55.348727 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7f654aa6-543c-42c5-be56-d14ee0c73cd0 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:55.350340 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7f654aa6-543c-42c5-be56-d14ee0c73cd0 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:55.591309 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-7f654aa6-543c-42c5-be56-d14ee0c73cd0 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a46d18160148f3a48ef4887f6ec7da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6284f2b80524eb0a36ccebaedba767a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:55.608963 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-7f654aa6-543c-42c5-be56-d14ee0c73cd0 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "GET /compute/v2.1/servers/5d8fcb1f-fa8f-4a61-8e8b-77a64053ca3c" status: 200 len: 1509 microversion: 2.1 time: 0.283028 Feb 17 04:37:55.611793 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 112/225] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:55 2021] GET /compute/v2.1/servers/5d8fcb1f-fa8f-4a61-8e8b-77a64053ca3c => generated 1509 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:55.630890 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-e1b63814-ef43-4b2a-acc5-5ccb7815c519 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a7265231-7982-4176-bea7-6c35eb2163ee"}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:37:55.632770 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-e1b63814-ef43-4b2a-acc5-5ccb7815c519 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: 5d8fcb1f-fa8f-4a61-8e8b-77a64053ca3c] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:55.642252 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e1b63814-ef43-4b2a-acc5-5ccb7815c519 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:55.643426 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e1b63814-ef43-4b2a-acc5-5ccb7815c519 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:55.644446 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e1b63814-ef43-4b2a-acc5-5ccb7815c519 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:55.645181 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e1b63814-ef43-4b2a-acc5-5ccb7815c519 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:55.705595 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-59530e36-3851-4cf5-baa6-bbd6ab35ced9 tempest-VolumesTestJSON-1986660052 tempest-VolumesTestJSON-1986660052-project] Calling method '.version_select at 0x7fc2e96c9ea0>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:55.816538 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-59530e36-3851-4cf5-baa6-bbd6ab35ced9 tempest-VolumesTestJSON-1986660052 tempest-VolumesTestJSON-1986660052-project] 10.222.0.38 "GET /compute/v2.1/os-volumes/80a0caab-23ea-4797-95bd-13c80b1c7e6b" status: 200 len: 350 microversion: 2.1 time: 0.116138 Feb 17 04:37:55.818611 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 113/226] 10.222.0.38 () {58 vars in 1235 bytes} [Wed Feb 17 04:37:55 2021] GET /compute/v2.1/os-volumes/80a0caab-23ea-4797-95bd-13c80b1c7e6b => generated 350 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:37:55.832148 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-2174466e-e2c7-42bb-ae93-6dada5f4129d tempest-VolumesTestJSON-1986660052 tempest-VolumesTestJSON-1986660052-project] Calling method '.version_select at 0x7fc2e9752bf8>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:55.874497 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.wsgi [None req-e1b63814-ef43-4b2a-acc5-5ccb7815c519 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] HTTP exception thrown: Invalid volume: volume a7265231-7982-4176-bea7-6c35eb2163ee is already attached to instances: 3ba4c3af-2d1e-4f4a-93e2-0e77d090962d Feb 17 04:37:55.876211 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-e1b63814-ef43-4b2a-acc5-5ccb7815c519 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Returning 400 to user: Invalid volume: volume a7265231-7982-4176-bea7-6c35eb2163ee is already attached to instances: 3ba4c3af-2d1e-4f4a-93e2-0e77d090962d {{(pid=98081) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:37:55.880715 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-e1b63814-ef43-4b2a-acc5-5ccb7815c519 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "POST /compute/v2.1/servers/5d8fcb1f-fa8f-4a61-8e8b-77a64053ca3c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.255860 Feb 17 04:37:55.881448 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 114/227] 10.222.0.38 () {60 vars in 1313 bytes} [Wed Feb 17 04:37:55 2021] POST /compute/v2.1/servers/5d8fcb1f-fa8f-4a61-8e8b-77a64053ca3c/os-volume_attachments => generated 174 bytes in 257 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 17 04:37:55.913175 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-172fdebb-3617-466d-aad0-1a5ee6170932 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:37:55.914435 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-172fdebb-3617-466d-aad0-1a5ee6170932 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:55.930379 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-172fdebb-3617-466d-aad0-1a5ee6170932 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:55.933086 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-172fdebb-3617-466d-aad0-1a5ee6170932 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:55.936148 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-2174466e-e2c7-42bb-ae93-6dada5f4129d tempest-VolumesTestJSON-1986660052 tempest-VolumesTestJSON-1986660052-project] 10.222.0.38 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.108689 Feb 17 04:37:55.937367 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 114/228] 10.222.0.38 () {58 vars in 1124 bytes} [Wed Feb 17 04:37:55 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:37:55.937479 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-172fdebb-3617-466d-aad0-1a5ee6170932 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:55.938212 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-172fdebb-3617-466d-aad0-1a5ee6170932 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:55.960259 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-cac41296-ac81-42ea-b103-e10f82ae3700 tempest-VolumesTestJSON-1986660052 tempest-VolumesTestJSON-1986660052-project] Calling method '.version_select at 0x7fc2e96bf840>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:56.170986 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-172fdebb-3617-466d-aad0-1a5ee6170932 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "POST /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/action" status: 200 len: 27594 microversion: 2.20 time: 0.262155 Feb 17 04:37:56.175191 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 115/229] 10.222.0.38 () {62 vars in 1309 bytes} [Wed Feb 17 04:37:55 2021] POST /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/action => generated 27594 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:37:56.177807 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-41e18d08-4570-4d74-ab44-a7253f454de4 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:56.178606 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-41e18d08-4570-4d74-ab44-a7253f454de4 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 1c099afc-d941-4044-83cc-39185d6d57b0] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:56.192310 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-41e18d08-4570-4d74-ab44-a7253f454de4 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:56.193448 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-41e18d08-4570-4d74-ab44-a7253f454de4 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:56.194671 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-41e18d08-4570-4d74-ab44-a7253f454de4 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:56.195322 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-41e18d08-4570-4d74-ab44-a7253f454de4 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:56.257466 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-cac41296-ac81-42ea-b103-e10f82ae3700 tempest-VolumesTestJSON-1986660052 tempest-VolumesTestJSON-1986660052-project] 10.222.0.38 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.309978 Feb 17 04:37:56.265694 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 115/230] 10.222.0.38 () {58 vars in 1139 bytes} [Wed Feb 17 04:37:55 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:37:56.265694 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-97281e66-fdaa-4dc6-9e94-47f8eb06adeb tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:56.265694 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-97281e66-fdaa-4dc6-9e94-47f8eb06adeb tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: 3ba4c3af-2d1e-4f4a-93e2-0e77d090962d] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:56.277241 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-97281e66-fdaa-4dc6-9e94-47f8eb06adeb tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:56.277890 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-97281e66-fdaa-4dc6-9e94-47f8eb06adeb tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:56.279458 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-97281e66-fdaa-4dc6-9e94-47f8eb06adeb tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:56.280358 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-97281e66-fdaa-4dc6-9e94-47f8eb06adeb tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:56.429996 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-41e18d08-4570-4d74-ab44-a7253f454de4 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:56.440046 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-41e18d08-4570-4d74-ab44-a7253f454de4 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0" status: 200 len: 1521 microversion: 2.1 time: 0.266678 Feb 17 04:37:56.440947 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 116/231] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:56 2021] GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0 => generated 1521 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:56.447503 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-946a0552-d67b-4523-ac92-ccc418ee6ac5 tempest-VolumesTestJSON-1986660052 tempest-VolumesTestJSON-1986660052-project] Calling method '.version_select at 0x7fc2ea060400>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:56.498388 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.objects.instance [None req-97281e66-fdaa-4dc6-9e94-47f8eb06adeb tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lazy-loading 'services' on Instance uuid 3ba4c3af-2d1e-4f4a-93e2-0e77d090962d {{(pid=98080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:37:56.584362 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-946a0552-d67b-4523-ac92-ccc418ee6ac5 tempest-VolumesTestJSON-1986660052 tempest-VolumesTestJSON-1986660052-project] 10.222.0.38 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.142079 Feb 17 04:37:56.585031 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 117/232] 10.222.0.38 () {58 vars in 1124 bytes} [Wed Feb 17 04:37:56 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:56.596668 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-198dd17d-dca0-463b-b312-1ae554c86d82 tempest-VolumesTestJSON-1986660052 tempest-VolumesTestJSON-1986660052-project] Calling method '.version_select at 0x7fc2ea0109d8>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:56.687710 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-97281e66-fdaa-4dc6-9e94-47f8eb06adeb tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "DELETE /compute/v2.1/servers/3ba4c3af-2d1e-4f4a-93e2-0e77d090962d/os-volume_attachments/a7265231-7982-4176-bea7-6c35eb2163ee" status: 202 len: 0 microversion: 2.1 time: 0.427498 Feb 17 04:37:56.688586 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 116/233] 10.222.0.38 () {58 vars in 1406 bytes} [Wed Feb 17 04:37:56 2021] DELETE /compute/v2.1/servers/3ba4c3af-2d1e-4f4a-93e2-0e77d090962d/os-volume_attachments/a7265231-7982-4176-bea7-6c35eb2163ee => generated 0 bytes in 430 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:37:56.776410 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-198dd17d-dca0-463b-b312-1ae554c86d82 tempest-VolumesTestJSON-1986660052 tempest-VolumesTestJSON-1986660052-project] 10.222.0.38 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.183480 Feb 17 04:37:56.787271 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 118/234] 10.222.0.38 () {58 vars in 1157 bytes} [Wed Feb 17 04:37:56 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:37:56.792092 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-9b28f13e-f5bb-4c91-9e71-1021fb875bcc tempest-VolumesTestJSON-1986660052 tempest-VolumesTestJSON-1986660052-project] Calling method '.version_select at 0x7fc2e96c9f28>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:57.011122 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-9b28f13e-f5bb-4c91-9e71-1021fb875bcc tempest-VolumesTestJSON-1986660052 tempest-VolumesTestJSON-1986660052-project] 10.222.0.38 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.223381 Feb 17 04:37:57.013451 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 117/235] 10.222.0.38 () {58 vars in 1160 bytes} [Wed Feb 17 04:37:56 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:37:57.028355 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-050cc08a-d700-4bcb-81e5-c1da8dfc9eda tempest-VolumesTestJSON-1986660052 tempest-VolumesTestJSON-1986660052-project] Calling method '.version_select at 0x7fc2ea060f28>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:57.144133 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-050cc08a-d700-4bcb-81e5-c1da8dfc9eda tempest-VolumesTestJSON-1986660052 tempest-VolumesTestJSON-1986660052-project] 10.222.0.38 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.120041 Feb 17 04:37:57.145001 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 119/236] 10.222.0.38 () {58 vars in 1145 bytes} [Wed Feb 17 04:37:57 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:57.157378 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-b8a42774-a7a4-4467-9be6-36f21cc135e9 tempest-VolumesTestJSON-1986660052 tempest-VolumesTestJSON-1986660052-project] Calling method '.version_select at 0x7fc2e974bc80>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:57.184430 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-17f5b7ff-5219-4131-bf10-e29f35c4ae6d tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:37:57.185509 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-17f5b7ff-5219-4131-bf10-e29f35c4ae6d tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:57.202240 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-17f5b7ff-5219-4131-bf10-e29f35c4ae6d tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:57.202961 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-17f5b7ff-5219-4131-bf10-e29f35c4ae6d tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:57.205434 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-17f5b7ff-5219-4131-bf10-e29f35c4ae6d tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:57.230607 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-17f5b7ff-5219-4131-bf10-e29f35c4ae6d tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:57.309621 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-b8a42774-a7a4-4467-9be6-36f21cc135e9 tempest-VolumesTestJSON-1986660052 tempest-VolumesTestJSON-1986660052-project] 10.222.0.38 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.155796 Feb 17 04:37:57.310401 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 118/237] 10.222.0.38 () {58 vars in 1178 bytes} [Wed Feb 17 04:37:57 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:37:57.325724 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-8a44b23f-68a8-4174-b3f5-c3e2443b52ef tempest-VolumesTestJSON-1986660052 tempest-VolumesTestJSON-1986660052-project] Calling method '.version_select at 0x7fc2e96bf730>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:57.399547 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-17f5b7ff-5219-4131-bf10-e29f35c4ae6d tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "POST /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/action" status: 200 len: 27825 microversion: 2.20 time: 0.207266 Feb 17 04:37:57.400826 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 120/238] 10.222.0.38 () {62 vars in 1309 bytes} [Wed Feb 17 04:37:57 2021] POST /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/action => generated 27825 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:37:57.419202 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-8a44b23f-68a8-4174-b3f5-c3e2443b52ef tempest-VolumesTestJSON-1986660052 tempest-VolumesTestJSON-1986660052-project] 10.222.0.38 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.097631 Feb 17 04:37:57.419812 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 119/239] 10.222.0.38 () {58 vars in 1145 bytes} [Wed Feb 17 04:37:57 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:57.461998 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-4d4a22f2-e071-47de-a79a-9894590156eb tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:57.463105 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-4d4a22f2-e071-47de-a79a-9894590156eb tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 1c099afc-d941-4044-83cc-39185d6d57b0] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:57.477731 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4d4a22f2-e071-47de-a79a-9894590156eb tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:57.478548 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4d4a22f2-e071-47de-a79a-9894590156eb tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:57.480021 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4d4a22f2-e071-47de-a79a-9894590156eb tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:57.480608 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4d4a22f2-e071-47de-a79a-9894590156eb tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:57.759660 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-4d4a22f2-e071-47de-a79a-9894590156eb tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:57.772262 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-4d4a22f2-e071-47de-a79a-9894590156eb tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0" status: 200 len: 1521 microversion: 2.1 time: 0.314377 Feb 17 04:37:57.773177 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 121/240] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:57 2021] GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0 => generated 1521 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:58.413451 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-c0f41410-8cc2-4406-b0ac-1bf535873666 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:37:58.414730 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-c0f41410-8cc2-4406-b0ac-1bf535873666 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:58.422851 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c0f41410-8cc2-4406-b0ac-1bf535873666 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:58.423363 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c0f41410-8cc2-4406-b0ac-1bf535873666 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:58.424243 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c0f41410-8cc2-4406-b0ac-1bf535873666 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:58.424895 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c0f41410-8cc2-4406-b0ac-1bf535873666 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:58.572766 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-c0f41410-8cc2-4406-b0ac-1bf535873666 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "POST /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/action" status: 200 len: 28247 microversion: 2.20 time: 0.164050 Feb 17 04:37:58.574103 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 120/241] 10.222.0.38 () {62 vars in 1309 bytes} [Wed Feb 17 04:37:58 2021] POST /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/action => generated 28247 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:37:58.791084 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-f0b6c8ac-94d9-44c0-8fc7-df570bb14d4a tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:37:58.792354 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-f0b6c8ac-94d9-44c0-8fc7-df570bb14d4a tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 1c099afc-d941-4044-83cc-39185d6d57b0] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:58.806052 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f0b6c8ac-94d9-44c0-8fc7-df570bb14d4a tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:58.811826 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f0b6c8ac-94d9-44c0-8fc7-df570bb14d4a tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:58.812836 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f0b6c8ac-94d9-44c0-8fc7-df570bb14d4a tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:58.819348 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f0b6c8ac-94d9-44c0-8fc7-df570bb14d4a tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:59.129841 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-f0b6c8ac-94d9-44c0-8fc7-df570bb14d4a tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:37:59.140428 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-f0b6c8ac-94d9-44c0-8fc7-df570bb14d4a tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0" status: 200 len: 1521 microversion: 2.1 time: 0.354097 Feb 17 04:37:59.141127 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 122/242] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:37:58 2021] GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0 => generated 1521 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:37:59.297862 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-56decfed-090a-421b-b780-b997dd3dc21b tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1062940446", "imageRef": "2d6991a7-a1f0-444b-8fd5-d05558b5f9a4", "flavorRef": "452", "networks": [{"uuid": "3eac4670-46fd-4c18-9c55-ed035eb365fd"}]}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:37:59.366427 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.network.neutron [None req-56decfed-090a-421b-b780-b997dd3dc21b tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] validate_networks() for [('3eac4670-46fd-4c18-9c55-ed035eb365fd', None, None, None)] {{(pid=98080) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 04:37:59.586943 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-0ef7d660-d307-4b31-95cb-8b9b8c26bcd8 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:37:59.588536 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-0ef7d660-d307-4b31-95cb-8b9b8c26bcd8 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:37:59.598358 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0ef7d660-d307-4b31-95cb-8b9b8c26bcd8 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:59.599191 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0ef7d660-d307-4b31-95cb-8b9b8c26bcd8 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:59.600584 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0ef7d660-d307-4b31-95cb-8b9b8c26bcd8 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:37:59.601239 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0ef7d660-d307-4b31-95cb-8b9b8c26bcd8 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:37:59.744711 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-0ef7d660-d307-4b31-95cb-8b9b8c26bcd8 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "POST /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/action" status: 200 len: 28247 microversion: 2.20 time: 0.162919 Feb 17 04:37:59.749052 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 123/243] 10.222.0.38 () {62 vars in 1309 bytes} [Wed Feb 17 04:37:59 2021] POST /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/action => generated 28247 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:38:00.022979 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-56decfed-090a-421b-b780-b997dd3dc21b tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Flavor limits 0:0:0 {{(pid=98080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 04:38:00.023467 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-56decfed-090a-421b-b780-b997dd3dc21b tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Image limits 0:0:0 {{(pid=98080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 04:38:00.023985 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-56decfed-090a-421b-b780-b997dd3dc21b tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Flavor pref 0:0:0 {{(pid=98080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 04:38:00.024455 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-56decfed-090a-421b-b780-b997dd3dc21b tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Image pref 0:0:0 {{(pid=98080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 04:38:00.024904 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-56decfed-090a-421b-b780-b997dd3dc21b tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 04:38:00.034552 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-56decfed-090a-421b-b780-b997dd3dc21b tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:00.035094 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-56decfed-090a-421b-b780-b997dd3dc21b tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:00.036653 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-56decfed-090a-421b-b780-b997dd3dc21b tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:00.037311 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-56decfed-090a-421b-b780-b997dd3dc21b tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:00.073181 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.quota [None req-56decfed-090a-421b-b780-b997dd3dc21b tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Getting quotas for project a6284f2b80524eb0a36ccebaedba767a. Resources: {'instances', 'cores', 'ram'} {{(pid=98080) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:38:00.080773 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.quota [None req-56decfed-090a-421b-b780-b997dd3dc21b tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Getting quotas for user 38a46d18160148f3a48ef4887f6ec7da and project a6284f2b80524eb0a36ccebaedba767a. Resources: {'instances', 'cores', 'ram'} {{(pid=98080) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:38:00.101469 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-56decfed-090a-421b-b780-b997dd3dc21b tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Going to run 1 instances... {{(pid=98080) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 04:38:00.104490 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-56decfed-090a-421b-b780-b997dd3dc21b tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: 4c526cd8-5f97-4b6f-af6a-ab22442bf0d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d6991a7-a1f0-444b-8fd5-d05558b5f9a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98080) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 04:38:00.159953 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-585fd65b-6092-4d4d-ba4f-fa27a7a81392 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:00.161534 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-585fd65b-6092-4d4d-ba4f-fa27a7a81392 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 1c099afc-d941-4044-83cc-39185d6d57b0] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:00.168573 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-56decfed-090a-421b-b780-b997dd3dc21b tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.875125 Feb 17 04:38:00.169477 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 121/244] 10.222.0.38 () {60 vars in 1137 bytes} [Wed Feb 17 04:37:59 2021] POST /compute/v2.1/servers => generated 380 bytes in 877 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 17 04:38:00.179231 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-585fd65b-6092-4d4d-ba4f-fa27a7a81392 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:00.180084 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-cea9d7ed-ef66-447e-8db7-3036ff36b0ca tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:00.180752 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-cea9d7ed-ef66-447e-8db7-3036ff36b0ca tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: 4c526cd8-5f97-4b6f-af6a-ab22442bf0d6] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:00.181456 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-585fd65b-6092-4d4d-ba4f-fa27a7a81392 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:00.184310 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-585fd65b-6092-4d4d-ba4f-fa27a7a81392 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:00.187136 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-585fd65b-6092-4d4d-ba4f-fa27a7a81392 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:00.282164 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-cea9d7ed-ef66-447e-8db7-3036ff36b0ca tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a46d18160148f3a48ef4887f6ec7da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6284f2b80524eb0a36ccebaedba767a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:00.295623 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-cea9d7ed-ef66-447e-8db7-3036ff36b0ca tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "GET /compute/v2.1/servers/4c526cd8-5f97-4b6f-af6a-ab22442bf0d6" status: 200 len: 1218 microversion: 2.1 time: 0.118253 Feb 17 04:38:00.306996 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 122/245] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:00 2021] GET /compute/v2.1/servers/4c526cd8-5f97-4b6f-af6a-ab22442bf0d6 => generated 1218 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:38:00.557070 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-585fd65b-6092-4d4d-ba4f-fa27a7a81392 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:00.569678 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-585fd65b-6092-4d4d-ba4f-fa27a7a81392 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0" status: 200 len: 1521 microversion: 2.1 time: 0.414239 Feb 17 04:38:00.570306 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 124/246] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:00 2021] GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0 => generated 1521 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:00.758133 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-47351d5a-4620-48b7-b710-fb8e97724bec tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:00.759616 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-47351d5a-4620-48b7-b710-fb8e97724bec tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:00.768338 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-47351d5a-4620-48b7-b710-fb8e97724bec tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:00.768859 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-47351d5a-4620-48b7-b710-fb8e97724bec tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:00.769843 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-47351d5a-4620-48b7-b710-fb8e97724bec tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:00.770369 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-47351d5a-4620-48b7-b710-fb8e97724bec tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:00.923240 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-47351d5a-4620-48b7-b710-fb8e97724bec tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "POST /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/action" status: 200 len: 28441 microversion: 2.20 time: 0.169586 Feb 17 04:38:00.923955 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 123/247] 10.222.0.38 () {62 vars in 1309 bytes} [Wed Feb 17 04:38:00 2021] POST /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/action => generated 28441 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:38:01.316826 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-1ee32486-8888-41e3-b3db-e44c3e910d90 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:01.317504 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-1ee32486-8888-41e3-b3db-e44c3e910d90 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: 4c526cd8-5f97-4b6f-af6a-ab22442bf0d6] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:01.326459 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1ee32486-8888-41e3-b3db-e44c3e910d90 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:01.327129 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1ee32486-8888-41e3-b3db-e44c3e910d90 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:01.327974 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1ee32486-8888-41e3-b3db-e44c3e910d90 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:01.328465 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1ee32486-8888-41e3-b3db-e44c3e910d90 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:01.472111 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-1ee32486-8888-41e3-b3db-e44c3e910d90 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a46d18160148f3a48ef4887f6ec7da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6284f2b80524eb0a36ccebaedba767a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:01.485086 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-1ee32486-8888-41e3-b3db-e44c3e910d90 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "GET /compute/v2.1/servers/4c526cd8-5f97-4b6f-af6a-ab22442bf0d6" status: 200 len: 1270 microversion: 2.1 time: 0.172275 Feb 17 04:38:01.485971 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 125/248] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:01 2021] GET /compute/v2.1/servers/4c526cd8-5f97-4b6f-af6a-ab22442bf0d6 => generated 1270 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:01.589412 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-1e5e8869-f782-4668-b7e3-5db8e4d3bbc9 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:01.590803 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-1e5e8869-f782-4668-b7e3-5db8e4d3bbc9 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 1c099afc-d941-4044-83cc-39185d6d57b0] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:01.600926 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1e5e8869-f782-4668-b7e3-5db8e4d3bbc9 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:01.601439 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1e5e8869-f782-4668-b7e3-5db8e4d3bbc9 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:01.602299 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1e5e8869-f782-4668-b7e3-5db8e4d3bbc9 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:01.602831 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1e5e8869-f782-4668-b7e3-5db8e4d3bbc9 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:01.937593 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-729aff90-6323-4b76-bc46-021ab314d1d3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:01.938862 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-729aff90-6323-4b76-bc46-021ab314d1d3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:01.960406 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-729aff90-6323-4b76-bc46-021ab314d1d3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:01.961273 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-729aff90-6323-4b76-bc46-021ab314d1d3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:01.962509 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-729aff90-6323-4b76-bc46-021ab314d1d3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:01.963490 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-729aff90-6323-4b76-bc46-021ab314d1d3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:02.098015 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-1e5e8869-f782-4668-b7e3-5db8e4d3bbc9 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:02.107396 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-1e5e8869-f782-4668-b7e3-5db8e4d3bbc9 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0" status: 200 len: 1521 microversion: 2.1 time: 0.523198 Feb 17 04:38:02.108246 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 124/249] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:01 2021] GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0 => generated 1521 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:02.144293 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-729aff90-6323-4b76-bc46-021ab314d1d3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "POST /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/action" status: 200 len: 28536 microversion: 2.20 time: 0.211696 Feb 17 04:38:02.144988 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 126/250] 10.222.0.38 () {62 vars in 1309 bytes} [Wed Feb 17 04:38:01 2021] POST /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/action => generated 28536 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 04:38:02.505076 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-4145c593-3e1f-4800-8c71-1eaa04434bd4 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:02.505754 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-4145c593-3e1f-4800-8c71-1eaa04434bd4 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: 4c526cd8-5f97-4b6f-af6a-ab22442bf0d6] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:02.513838 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4145c593-3e1f-4800-8c71-1eaa04434bd4 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:02.514348 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4145c593-3e1f-4800-8c71-1eaa04434bd4 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:02.515236 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4145c593-3e1f-4800-8c71-1eaa04434bd4 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:02.515730 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4145c593-3e1f-4800-8c71-1eaa04434bd4 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:02.700648 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-4145c593-3e1f-4800-8c71-1eaa04434bd4 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a46d18160148f3a48ef4887f6ec7da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6284f2b80524eb0a36ccebaedba767a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:02.711040 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-4145c593-3e1f-4800-8c71-1eaa04434bd4 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "GET /compute/v2.1/servers/4c526cd8-5f97-4b6f-af6a-ab22442bf0d6" status: 200 len: 1276 microversion: 2.1 time: 0.209814 Feb 17 04:38:02.711846 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 125/251] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:02 2021] GET /compute/v2.1/servers/4c526cd8-5f97-4b6f-af6a-ab22442bf0d6 => generated 1276 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:03.126620 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-742e3a70-1d9e-4259-b89b-2f959fb98d2d tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:03.127858 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-742e3a70-1d9e-4259-b89b-2f959fb98d2d tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 1c099afc-d941-4044-83cc-39185d6d57b0] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:03.137919 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-742e3a70-1d9e-4259-b89b-2f959fb98d2d tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:03.138711 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-742e3a70-1d9e-4259-b89b-2f959fb98d2d tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:03.139731 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-742e3a70-1d9e-4259-b89b-2f959fb98d2d tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:03.140399 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-742e3a70-1d9e-4259-b89b-2f959fb98d2d tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:03.158932 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-d4133165-d2f6-494b-9c40-9a4f667aced3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:03.160161 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-d4133165-d2f6-494b-9c40-9a4f667aced3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:03.178875 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d4133165-d2f6-494b-9c40-9a4f667aced3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:03.179391 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d4133165-d2f6-494b-9c40-9a4f667aced3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:03.180266 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d4133165-d2f6-494b-9c40-9a4f667aced3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:03.180760 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d4133165-d2f6-494b-9c40-9a4f667aced3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:03.362346 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-d4133165-d2f6-494b-9c40-9a4f667aced3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "POST /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/action" status: 200 len: 28701 microversion: 2.20 time: 0.208551 Feb 17 04:38:03.370746 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 126/252] 10.222.0.38 () {62 vars in 1309 bytes} [Wed Feb 17 04:38:03 2021] POST /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/action => generated 28701 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:38:03.599912 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-742e3a70-1d9e-4259-b89b-2f959fb98d2d tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:03.611361 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-742e3a70-1d9e-4259-b89b-2f959fb98d2d tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0" status: 200 len: 1521 microversion: 2.1 time: 0.489186 Feb 17 04:38:03.612102 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 127/253] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:03 2021] GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0 => generated 1521 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:03.732416 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-04579c26-5ecc-4c23-b941-4d5b8fd01da0 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:03.733927 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-04579c26-5ecc-4c23-b941-4d5b8fd01da0 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: 4c526cd8-5f97-4b6f-af6a-ab22442bf0d6] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:03.745994 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-04579c26-5ecc-4c23-b941-4d5b8fd01da0 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:03.746679 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-04579c26-5ecc-4c23-b941-4d5b8fd01da0 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:03.747683 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-04579c26-5ecc-4c23-b941-4d5b8fd01da0 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:03.748314 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-04579c26-5ecc-4c23-b941-4d5b8fd01da0 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:04.298861 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-04579c26-5ecc-4c23-b941-4d5b8fd01da0 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a46d18160148f3a48ef4887f6ec7da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6284f2b80524eb0a36ccebaedba767a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:04.312053 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-04579c26-5ecc-4c23-b941-4d5b8fd01da0 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "GET /compute/v2.1/servers/4c526cd8-5f97-4b6f-af6a-ab22442bf0d6" status: 200 len: 1318 microversion: 2.1 time: 0.585938 Feb 17 04:38:04.319232 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 127/254] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:03 2021] GET /compute/v2.1/servers/4c526cd8-5f97-4b6f-af6a-ab22442bf0d6 => generated 1318 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:04.379470 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-e88a29d8-f307-458b-a50e-a3524f541e8c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:04.381003 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-e88a29d8-f307-458b-a50e-a3524f541e8c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:04.391325 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e88a29d8-f307-458b-a50e-a3524f541e8c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:04.392542 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e88a29d8-f307-458b-a50e-a3524f541e8c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:04.393628 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e88a29d8-f307-458b-a50e-a3524f541e8c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:04.394735 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e88a29d8-f307-458b-a50e-a3524f541e8c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:04.568994 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-e88a29d8-f307-458b-a50e-a3524f541e8c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "POST /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/action" status: 200 len: 28703 microversion: 2.20 time: 0.193772 Feb 17 04:38:04.571461 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 128/255] 10.222.0.38 () {62 vars in 1309 bytes} [Wed Feb 17 04:38:04 2021] POST /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/action => generated 28703 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:38:04.629393 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-362e2223-2c62-49b4-a9c2-ba10b3be6697 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:04.630334 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-362e2223-2c62-49b4-a9c2-ba10b3be6697 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 1c099afc-d941-4044-83cc-39185d6d57b0] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:04.638400 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-362e2223-2c62-49b4-a9c2-ba10b3be6697 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:04.639153 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-362e2223-2c62-49b4-a9c2-ba10b3be6697 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:04.640221 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-362e2223-2c62-49b4-a9c2-ba10b3be6697 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:04.640701 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-362e2223-2c62-49b4-a9c2-ba10b3be6697 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:05.336110 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-079d1af4-47cf-441d-9834-890e26a44a39 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:05.336921 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-079d1af4-47cf-441d-9834-890e26a44a39 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: 4c526cd8-5f97-4b6f-af6a-ab22442bf0d6] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:05.346273 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-079d1af4-47cf-441d-9834-890e26a44a39 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:05.347124 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-079d1af4-47cf-441d-9834-890e26a44a39 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:05.348992 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-079d1af4-47cf-441d-9834-890e26a44a39 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:05.349778 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-079d1af4-47cf-441d-9834-890e26a44a39 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:05.368458 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-362e2223-2c62-49b4-a9c2-ba10b3be6697 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:05.385014 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-362e2223-2c62-49b4-a9c2-ba10b3be6697 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0" status: 200 len: 1521 microversion: 2.1 time: 0.759379 Feb 17 04:38:05.385659 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 128/256] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:04 2021] GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0 => generated 1521 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:05.589393 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-e441869b-c083-4e19-847a-5a1c890d88cf tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:05.590581 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-e441869b-c083-4e19-847a-5a1c890d88cf tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:05.603085 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e441869b-c083-4e19-847a-5a1c890d88cf tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:05.603085 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e441869b-c083-4e19-847a-5a1c890d88cf tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:05.604136 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e441869b-c083-4e19-847a-5a1c890d88cf tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:05.604746 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e441869b-c083-4e19-847a-5a1c890d88cf tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:05.738674 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-e441869b-c083-4e19-847a-5a1c890d88cf tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "POST /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/action" status: 200 len: 28703 microversion: 2.20 time: 0.154346 Feb 17 04:38:05.742784 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 129/257] 10.222.0.38 () {62 vars in 1309 bytes} [Wed Feb 17 04:38:05 2021] POST /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/action => generated 28703 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 04:38:06.037302 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-079d1af4-47cf-441d-9834-890e26a44a39 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a46d18160148f3a48ef4887f6ec7da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6284f2b80524eb0a36ccebaedba767a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:06.052488 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-079d1af4-47cf-441d-9834-890e26a44a39 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "GET /compute/v2.1/servers/4c526cd8-5f97-4b6f-af6a-ab22442bf0d6" status: 200 len: 1318 microversion: 2.1 time: 0.726558 Feb 17 04:38:06.055272 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 129/258] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:05 2021] GET /compute/v2.1/servers/4c526cd8-5f97-4b6f-af6a-ab22442bf0d6 => generated 1318 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:06.111940 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [req-a39cded4-1ebb-403a-994c-101ca1b3d74e req-9b996b77-be1c-48a7-8c3a-247fd2b55b40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c526cd8-5f97-4b6f-af6a-ab22442bf0d6", "tag": "fc9a2ca9-56da-4fa9-aa32-1289ae7ac089"}]} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:06.114114 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:38:06.114114 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:38:06.138107 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-a39cded4-1ebb-403a-994c-101ca1b3d74e req-9b996b77-be1c-48a7-8c3a-247fd2b55b40 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:06.138632 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-a39cded4-1ebb-403a-994c-101ca1b3d74e req-9b996b77-be1c-48a7-8c3a-247fd2b55b40 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:06.179641 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.compute.server_external_events [req-a39cded4-1ebb-403a-994c-101ca1b3d74e req-9b996b77-be1c-48a7-8c3a-247fd2b55b40 service nova] Creating event network-changed:fc9a2ca9-56da-4fa9-aa32-1289ae7ac089 for instance 4c526cd8-5f97-4b6f-af6a-ab22442bf0d6 on hv-cinder-76019 Feb 17 04:38:06.186120 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [req-a39cded4-1ebb-403a-994c-101ca1b3d74e req-9b996b77-be1c-48a7-8c3a-247fd2b55b40 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094437 Feb 17 04:38:06.187617 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 130/259] 10.222.0.38 () {64 vars in 1308 bytes} [Wed Feb 17 04:38:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:38:06.413367 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-fb479ca1-23cd-4257-b201-6a7b6973f614 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:06.414890 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-fb479ca1-23cd-4257-b201-6a7b6973f614 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 1c099afc-d941-4044-83cc-39185d6d57b0] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:06.424240 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-fb479ca1-23cd-4257-b201-6a7b6973f614 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:06.425107 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-fb479ca1-23cd-4257-b201-6a7b6973f614 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:06.426389 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-fb479ca1-23cd-4257-b201-6a7b6973f614 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:06.427400 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-fb479ca1-23cd-4257-b201-6a7b6973f614 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:06.753027 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-5ee70cef-84c8-4ac8-8d1d-bd74155bf4ee tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:06.754688 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-5ee70cef-84c8-4ac8-8d1d-bd74155bf4ee tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:06.771879 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5ee70cef-84c8-4ac8-8d1d-bd74155bf4ee tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:06.773121 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5ee70cef-84c8-4ac8-8d1d-bd74155bf4ee tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:06.775221 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5ee70cef-84c8-4ac8-8d1d-bd74155bf4ee tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:06.777850 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5ee70cef-84c8-4ac8-8d1d-bd74155bf4ee tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:07.001538 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-5ee70cef-84c8-4ac8-8d1d-bd74155bf4ee tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "POST /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/action" status: 200 len: 28703 microversion: 2.20 time: 0.253222 Feb 17 04:38:07.002771 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 131/260] 10.222.0.38 () {62 vars in 1309 bytes} [Wed Feb 17 04:38:06 2021] POST /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/action => generated 28703 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:38:07.075369 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-d497c07e-c18e-48fb-9cf1-55eeadc672f1 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:07.076478 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-d497c07e-c18e-48fb-9cf1-55eeadc672f1 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: 4c526cd8-5f97-4b6f-af6a-ab22442bf0d6] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:07.094053 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d497c07e-c18e-48fb-9cf1-55eeadc672f1 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:07.096626 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d497c07e-c18e-48fb-9cf1-55eeadc672f1 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:07.101181 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d497c07e-c18e-48fb-9cf1-55eeadc672f1 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:07.101976 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d497c07e-c18e-48fb-9cf1-55eeadc672f1 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:07.526240 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-fb479ca1-23cd-4257-b201-6a7b6973f614 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:07.540402 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-fb479ca1-23cd-4257-b201-6a7b6973f614 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0" status: 200 len: 1521 microversion: 2.1 time: 1.138328 Feb 17 04:38:07.547807 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 130/261] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:06 2021] GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0 => generated 1521 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:07.906640 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-d497c07e-c18e-48fb-9cf1-55eeadc672f1 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a46d18160148f3a48ef4887f6ec7da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6284f2b80524eb0a36ccebaedba767a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:07.917592 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-d497c07e-c18e-48fb-9cf1-55eeadc672f1 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "GET /compute/v2.1/servers/4c526cd8-5f97-4b6f-af6a-ab22442bf0d6" status: 200 len: 1318 microversion: 2.1 time: 0.846958 Feb 17 04:38:07.918319 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 132/262] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:07 2021] GET /compute/v2.1/servers/4c526cd8-5f97-4b6f-af6a-ab22442bf0d6 => generated 1318 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:08.014161 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-8706ea77-ffa8-4dfe-94ca-324ab40c0f94 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:08.015758 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-8706ea77-ffa8-4dfe-94ca-324ab40c0f94 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:08.026088 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8706ea77-ffa8-4dfe-94ca-324ab40c0f94 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:08.026839 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8706ea77-ffa8-4dfe-94ca-324ab40c0f94 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:08.027882 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8706ea77-ffa8-4dfe-94ca-324ab40c0f94 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:08.028560 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8706ea77-ffa8-4dfe-94ca-324ab40c0f94 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:08.558159 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-00552d52-391a-4a46-9b35-b1a57578f19c tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:08.559765 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-00552d52-391a-4a46-9b35-b1a57578f19c tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 1c099afc-d941-4044-83cc-39185d6d57b0] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:08.568664 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-00552d52-391a-4a46-9b35-b1a57578f19c tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:08.569495 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-00552d52-391a-4a46-9b35-b1a57578f19c tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:08.570547 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-00552d52-391a-4a46-9b35-b1a57578f19c tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:08.571581 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-00552d52-391a-4a46-9b35-b1a57578f19c tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:08.995001 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-00552d52-391a-4a46-9b35-b1a57578f19c tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:09.012683 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-00552d52-391a-4a46-9b35-b1a57578f19c tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0" status: 200 len: 1521 microversion: 2.1 time: 0.456161 Feb 17 04:38:09.013625 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 133/263] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:08 2021] GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0 => generated 1521 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:09.029547 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-b50e2cae-dd7e-42ce-85e8-0b5be67c582a tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:09.047952 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-b50e2cae-dd7e-42ce-85e8-0b5be67c582a tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: 4c526cd8-5f97-4b6f-af6a-ab22442bf0d6] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:09.056747 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b50e2cae-dd7e-42ce-85e8-0b5be67c582a tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:09.057379 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b50e2cae-dd7e-42ce-85e8-0b5be67c582a tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:09.058334 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b50e2cae-dd7e-42ce-85e8-0b5be67c582a tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:09.058977 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b50e2cae-dd7e-42ce-85e8-0b5be67c582a tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:09.297322 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-b50e2cae-dd7e-42ce-85e8-0b5be67c582a tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a46d18160148f3a48ef4887f6ec7da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6284f2b80524eb0a36ccebaedba767a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:09.307707 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-b50e2cae-dd7e-42ce-85e8-0b5be67c582a tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "GET /compute/v2.1/servers/4c526cd8-5f97-4b6f-af6a-ab22442bf0d6" status: 200 len: 1318 microversion: 2.1 time: 0.292708 Feb 17 04:38:09.308673 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 134/264] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:09 2021] GET /compute/v2.1/servers/4c526cd8-5f97-4b6f-af6a-ab22442bf0d6 => generated 1318 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:10.031231 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-4d6f88cd-9894-4a3f-89f5-f402b22be992 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:10.031895 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-4d6f88cd-9894-4a3f-89f5-f402b22be992 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 1c099afc-d941-4044-83cc-39185d6d57b0] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:10.040334 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4d6f88cd-9894-4a3f-89f5-f402b22be992 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:10.042480 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4d6f88cd-9894-4a3f-89f5-f402b22be992 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:10.043612 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4d6f88cd-9894-4a3f-89f5-f402b22be992 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:10.044302 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4d6f88cd-9894-4a3f-89f5-f402b22be992 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:10.366107 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-4d6f88cd-9894-4a3f-89f5-f402b22be992 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:10.379206 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-4d6f88cd-9894-4a3f-89f5-f402b22be992 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0" status: 200 len: 1521 microversion: 2.1 time: 0.351871 Feb 17 04:38:10.379881 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 135/265] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:10 2021] GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0 => generated 1521 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:38:10.384641 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-43d2160d-4935-4560-b25b-821e3a4dc933 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:10.385497 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-43d2160d-4935-4560-b25b-821e3a4dc933 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: 4c526cd8-5f97-4b6f-af6a-ab22442bf0d6] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:10.394043 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-43d2160d-4935-4560-b25b-821e3a4dc933 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:10.394625 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-43d2160d-4935-4560-b25b-821e3a4dc933 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:10.397015 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-43d2160d-4935-4560-b25b-821e3a4dc933 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:10.397517 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-43d2160d-4935-4560-b25b-821e3a4dc933 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:10.636557 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-43d2160d-4935-4560-b25b-821e3a4dc933 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a46d18160148f3a48ef4887f6ec7da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6284f2b80524eb0a36ccebaedba767a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:10.645893 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-43d2160d-4935-4560-b25b-821e3a4dc933 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "GET /compute/v2.1/servers/4c526cd8-5f97-4b6f-af6a-ab22442bf0d6" status: 200 len: 1318 microversion: 2.1 time: 0.264742 Feb 17 04:38:10.652671 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 136/266] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:10 2021] GET /compute/v2.1/servers/4c526cd8-5f97-4b6f-af6a-ab22442bf0d6 => generated 1318 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:10.935727 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-8706ea77-ffa8-4dfe-94ca-324ab40c0f94 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "POST /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/action" status: 200 len: 28703 microversion: 2.20 time: 2.925817 Feb 17 04:38:10.937186 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 131/267] 10.222.0.38 () {62 vars in 1309 bytes} [Wed Feb 17 04:38:08 2021] POST /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/action => generated 28703 bytes in 2928 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:38:11.397354 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-5972a241-7bbe-4059-bef6-b9b30e9e5bc1 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:11.398135 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-5972a241-7bbe-4059-bef6-b9b30e9e5bc1 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 1c099afc-d941-4044-83cc-39185d6d57b0] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:11.406188 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5972a241-7bbe-4059-bef6-b9b30e9e5bc1 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:11.406871 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5972a241-7bbe-4059-bef6-b9b30e9e5bc1 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:11.407974 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5972a241-7bbe-4059-bef6-b9b30e9e5bc1 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:11.408566 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5972a241-7bbe-4059-bef6-b9b30e9e5bc1 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:11.667290 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-f391fd9b-6898-404b-9a30-d48d4d615d6f tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:11.670533 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-f391fd9b-6898-404b-9a30-d48d4d615d6f tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: 4c526cd8-5f97-4b6f-af6a-ab22442bf0d6] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:11.679680 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f391fd9b-6898-404b-9a30-d48d4d615d6f tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:11.680351 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f391fd9b-6898-404b-9a30-d48d4d615d6f tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:11.681203 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f391fd9b-6898-404b-9a30-d48d4d615d6f tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:11.681698 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f391fd9b-6898-404b-9a30-d48d4d615d6f tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:12.073933 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-5972a241-7bbe-4059-bef6-b9b30e9e5bc1 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:12.086961 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-5972a241-7bbe-4059-bef6-b9b30e9e5bc1 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0" status: 200 len: 1521 microversion: 2.1 time: 0.694491 Feb 17 04:38:12.096927 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 137/268] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:11 2021] GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0 => generated 1521 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:12.096927 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-aa30bf69-e2e3-4a13-a916-4dcea25dcca7 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:12.096927 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-aa30bf69-e2e3-4a13-a916-4dcea25dcca7 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:12.103238 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-aa30bf69-e2e3-4a13-a916-4dcea25dcca7 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:12.103877 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-aa30bf69-e2e3-4a13-a916-4dcea25dcca7 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:12.104973 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-aa30bf69-e2e3-4a13-a916-4dcea25dcca7 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:12.105686 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-aa30bf69-e2e3-4a13-a916-4dcea25dcca7 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:12.188725 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-f391fd9b-6898-404b-9a30-d48d4d615d6f tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a46d18160148f3a48ef4887f6ec7da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6284f2b80524eb0a36ccebaedba767a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:12.199605 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-f391fd9b-6898-404b-9a30-d48d4d615d6f tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "GET /compute/v2.1/servers/4c526cd8-5f97-4b6f-af6a-ab22442bf0d6" status: 200 len: 1318 microversion: 2.1 time: 0.539121 Feb 17 04:38:12.200230 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 132/269] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:11 2021] GET /compute/v2.1/servers/4c526cd8-5f97-4b6f-af6a-ab22442bf0d6 => generated 1318 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:12.275151 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-aa30bf69-e2e3-4a13-a916-4dcea25dcca7 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "POST /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/action" status: 200 len: 28703 microversion: 2.20 time: 0.185538 Feb 17 04:38:12.276091 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 138/270] 10.222.0.38 () {62 vars in 1309 bytes} [Wed Feb 17 04:38:12 2021] POST /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/action => generated 28703 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:38:12.716733 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-00f14fa9-f72d-4cbc-88ae-1099247ce227 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-809582554", "imageRef": "2d6991a7-a1f0-444b-8fd5-d05558b5f9a4", "flavorRef": "452", "networks": [{"uuid": "58123a5b-89a3-47b4-8bcf-bc477b9c807f"}]}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:12.790922 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.network.neutron [None req-00f14fa9-f72d-4cbc-88ae-1099247ce227 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] validate_networks() for [('58123a5b-89a3-47b4-8bcf-bc477b9c807f', None, None, None)] {{(pid=98081) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 04:38:13.105981 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-ab10b7f4-868c-429d-9d0a-7af3a992cd24 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:13.106902 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-ab10b7f4-868c-429d-9d0a-7af3a992cd24 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 1c099afc-d941-4044-83cc-39185d6d57b0] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:13.116506 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ab10b7f4-868c-429d-9d0a-7af3a992cd24 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:13.118079 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ab10b7f4-868c-429d-9d0a-7af3a992cd24 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:13.119114 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ab10b7f4-868c-429d-9d0a-7af3a992cd24 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:13.120773 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ab10b7f4-868c-429d-9d0a-7af3a992cd24 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:13.516155 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-ab10b7f4-868c-429d-9d0a-7af3a992cd24 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:13.525919 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-ab10b7f4-868c-429d-9d0a-7af3a992cd24 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0" status: 200 len: 1521 microversion: 2.1 time: 0.424624 Feb 17 04:38:13.526684 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 139/271] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:13 2021] GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0 => generated 1521 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:13.540128 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-00f14fa9-f72d-4cbc-88ae-1099247ce227 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Flavor limits 0:0:0 {{(pid=98081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 04:38:13.540706 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-00f14fa9-f72d-4cbc-88ae-1099247ce227 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Image limits 0:0:0 {{(pid=98081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 04:38:13.542035 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-00f14fa9-f72d-4cbc-88ae-1099247ce227 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Flavor pref 0:0:0 {{(pid=98081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 04:38:13.542760 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-00f14fa9-f72d-4cbc-88ae-1099247ce227 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Image pref 0:0:0 {{(pid=98081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 04:38:13.544309 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-00f14fa9-f72d-4cbc-88ae-1099247ce227 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 04:38:13.548463 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-f11bf005-ea6f-4daa-9ec9-2a9a59dc4331 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:13.550042 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-f11bf005-ea6f-4daa-9ec9-2a9a59dc4331 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: 4c526cd8-5f97-4b6f-af6a-ab22442bf0d6] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:13.558536 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f11bf005-ea6f-4daa-9ec9-2a9a59dc4331 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:13.559069 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f11bf005-ea6f-4daa-9ec9-2a9a59dc4331 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:13.560458 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f11bf005-ea6f-4daa-9ec9-2a9a59dc4331 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:13.560953 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f11bf005-ea6f-4daa-9ec9-2a9a59dc4331 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:13.561668 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-00f14fa9-f72d-4cbc-88ae-1099247ce227 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:13.562318 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-00f14fa9-f72d-4cbc-88ae-1099247ce227 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:13.563378 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-00f14fa9-f72d-4cbc-88ae-1099247ce227 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:13.564017 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-00f14fa9-f72d-4cbc-88ae-1099247ce227 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:13.585129 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.quota [None req-00f14fa9-f72d-4cbc-88ae-1099247ce227 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Getting quotas for project 8b23386679f44b7e9d4204ab1e9adf0a. Resources: {'instances', 'cores', 'ram'} {{(pid=98081) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:38:13.589623 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.quota [None req-00f14fa9-f72d-4cbc-88ae-1099247ce227 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Getting quotas for user d9a3efaa75e64645abf7555ccfe348d5 and project 8b23386679f44b7e9d4204ab1e9adf0a. Resources: {'instances', 'cores', 'ram'} {{(pid=98081) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:38:13.605006 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-00f14fa9-f72d-4cbc-88ae-1099247ce227 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Going to run 1 instances... {{(pid=98081) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 04:38:13.608157 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-00f14fa9-f72d-4cbc-88ae-1099247ce227 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] [instance: d9d6e198-85f5-488e-8317-d498205f37cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d6991a7-a1f0-444b-8fd5-d05558b5f9a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98081) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 04:38:13.672204 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-00f14fa9-f72d-4cbc-88ae-1099247ce227 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] 10.222.0.38 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.960965 Feb 17 04:38:13.673217 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 133/272] 10.222.0.38 () {60 vars in 1137 bytes} [Wed Feb 17 04:38:12 2021] POST /compute/v2.1/servers => generated 380 bytes in 964 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 17 04:38:13.679164 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-82db42b5-a968-4d9b-ab63-805c478cc878 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:13.680512 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-82db42b5-a968-4d9b-ab63-805c478cc878 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:13.690219 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-82db42b5-a968-4d9b-ab63-805c478cc878 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:13.690781 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-82db42b5-a968-4d9b-ab63-805c478cc878 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:13.692724 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-82db42b5-a968-4d9b-ab63-805c478cc878 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:13.693235 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-82db42b5-a968-4d9b-ab63-805c478cc878 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:13.824693 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-82db42b5-a968-4d9b-ab63-805c478cc878 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "POST /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/action" status: 200 len: 28703 microversion: 2.20 time: 0.149995 Feb 17 04:38:13.828907 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 134/273] 10.222.0.38 () {62 vars in 1309 bytes} [Wed Feb 17 04:38:13 2021] POST /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/action => generated 28703 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:38:13.829478 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-f11bf005-ea6f-4daa-9ec9-2a9a59dc4331 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a46d18160148f3a48ef4887f6ec7da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6284f2b80524eb0a36ccebaedba767a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:13.842255 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-f11bf005-ea6f-4daa-9ec9-2a9a59dc4331 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "GET /compute/v2.1/servers/4c526cd8-5f97-4b6f-af6a-ab22442bf0d6" status: 200 len: 1318 microversion: 2.1 time: 0.298212 Feb 17 04:38:13.842915 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 140/274] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:13 2021] GET /compute/v2.1/servers/4c526cd8-5f97-4b6f-af6a-ab22442bf0d6 => generated 1318 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:13.844237 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-43fc9510-b506-4b36-8eff-f5272efac62c tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:13.845482 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-43fc9510-b506-4b36-8eff-f5272efac62c tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] [instance: d9d6e198-85f5-488e-8317-d498205f37cc] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:13.933852 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-43fc9510-b506-4b36-8eff-f5272efac62c tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a3efaa75e64645abf7555ccfe348d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b23386679f44b7e9d4204ab1e9adf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:13.944749 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-43fc9510-b506-4b36-8eff-f5272efac62c tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] 10.222.0.38 "GET /compute/v2.1/servers/d9d6e198-85f5-488e-8317-d498205f37cc" status: 200 len: 1218 microversion: 2.1 time: 0.113332 Feb 17 04:38:13.945551 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 135/275] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:13 2021] GET /compute/v2.1/servers/d9d6e198-85f5-488e-8317-d498205f37cc => generated 1218 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:14.404042 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [req-df9b5dad-a56f-41ab-a545-c29a32657174 req-7277d52b-e13a-44b2-8044-19b961944b60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c526cd8-5f97-4b6f-af6a-ab22442bf0d6", "name": "network-vif-plugged", "status": "completed", "tag": "fc9a2ca9-56da-4fa9-aa32-1289ae7ac089"}]} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:14.405928 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:38:14.405928 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:38:14.429471 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-df9b5dad-a56f-41ab-a545-c29a32657174 req-7277d52b-e13a-44b2-8044-19b961944b60 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:14.430092 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-df9b5dad-a56f-41ab-a545-c29a32657174 req-7277d52b-e13a-44b2-8044-19b961944b60 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:14.467715 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.compute.server_external_events [req-df9b5dad-a56f-41ab-a545-c29a32657174 req-7277d52b-e13a-44b2-8044-19b961944b60 service nova] Creating event network-vif-plugged:fc9a2ca9-56da-4fa9-aa32-1289ae7ac089 for instance 4c526cd8-5f97-4b6f-af6a-ab22442bf0d6 on hv-cinder-76019 Feb 17 04:38:14.474096 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [req-df9b5dad-a56f-41ab-a545-c29a32657174 req-7277d52b-e13a-44b2-8044-19b961944b60 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074064 Feb 17 04:38:14.475391 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 141/276] 10.222.0.38 () {64 vars in 1308 bytes} [Wed Feb 17 04:38:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:38:14.565978 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-5e463d55-6b04-455e-9095-095f359df238 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:14.569222 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-5e463d55-6b04-455e-9095-095f359df238 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 1c099afc-d941-4044-83cc-39185d6d57b0] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:14.593378 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5e463d55-6b04-455e-9095-095f359df238 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:14.593868 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5e463d55-6b04-455e-9095-095f359df238 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:14.594919 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5e463d55-6b04-455e-9095-095f359df238 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:14.595569 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5e463d55-6b04-455e-9095-095f359df238 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:14.839792 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-daccf53f-7db1-4aa6-b1dd-3f7982be846d tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:14.841906 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-daccf53f-7db1-4aa6-b1dd-3f7982be846d tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:14.859476 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-daccf53f-7db1-4aa6-b1dd-3f7982be846d tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:14.860242 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-daccf53f-7db1-4aa6-b1dd-3f7982be846d tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:14.866953 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-daccf53f-7db1-4aa6-b1dd-3f7982be846d tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:14.867845 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-daccf53f-7db1-4aa6-b1dd-3f7982be846d tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:14.935650 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-5e463d55-6b04-455e-9095-095f359df238 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:14.977585 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-5e463d55-6b04-455e-9095-095f359df238 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0" status: 200 len: 1501 microversion: 2.1 time: 0.432683 Feb 17 04:38:14.978197 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 136/277] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:14 2021] GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0 => generated 1501 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:15.004395 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-62c2988c-758a-4453-bd93-3997fcf8dc43 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:15.016211 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-62c2988c-758a-4453-bd93-3997fcf8dc43 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: 4c526cd8-5f97-4b6f-af6a-ab22442bf0d6] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:15.030871 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-62c2988c-758a-4453-bd93-3997fcf8dc43 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:15.032659 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-62c2988c-758a-4453-bd93-3997fcf8dc43 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:15.035189 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-62c2988c-758a-4453-bd93-3997fcf8dc43 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:15.036452 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-62c2988c-758a-4453-bd93-3997fcf8dc43 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:15.164703 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-daccf53f-7db1-4aa6-b1dd-3f7982be846d tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "POST /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/action" status: 200 len: 29462 microversion: 2.20 time: 0.330015 Feb 17 04:38:15.165622 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 142/278] 10.222.0.38 () {62 vars in 1309 bytes} [Wed Feb 17 04:38:14 2021] POST /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/action => generated 29462 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:38:15.170810 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-c93cd5fc-5858-465a-843b-69fd8f50bc4d tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:15.171571 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-c93cd5fc-5858-465a-843b-69fd8f50bc4d tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] [instance: d9d6e198-85f5-488e-8317-d498205f37cc] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:15.189457 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c93cd5fc-5858-465a-843b-69fd8f50bc4d tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:15.189964 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c93cd5fc-5858-465a-843b-69fd8f50bc4d tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:15.190873 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c93cd5fc-5858-465a-843b-69fd8f50bc4d tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:15.191376 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c93cd5fc-5858-465a-843b-69fd8f50bc4d tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:15.393128 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-c93cd5fc-5858-465a-843b-69fd8f50bc4d tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a3efaa75e64645abf7555ccfe348d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b23386679f44b7e9d4204ab1e9adf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:15.405644 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-c93cd5fc-5858-465a-843b-69fd8f50bc4d tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] 10.222.0.38 "GET /compute/v2.1/servers/d9d6e198-85f5-488e-8317-d498205f37cc" status: 200 len: 1270 microversion: 2.1 time: 0.238639 Feb 17 04:38:15.406484 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 143/279] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:15 2021] GET /compute/v2.1/servers/d9d6e198-85f5-488e-8317-d498205f37cc => generated 1270 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:15.414989 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-09c8a30a-052e-49fa-b0e2-eb526c6fc44d tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:15.415896 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-09c8a30a-052e-49fa-b0e2-eb526c6fc44d tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 68a5c561-c418-4a68-b8b3-1600b638b80c] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:15.427146 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-09c8a30a-052e-49fa-b0e2-eb526c6fc44d tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:15.427920 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-09c8a30a-052e-49fa-b0e2-eb526c6fc44d tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:15.430005 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-09c8a30a-052e-49fa-b0e2-eb526c6fc44d tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:15.430694 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-09c8a30a-052e-49fa-b0e2-eb526c6fc44d tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:15.622907 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-62c2988c-758a-4453-bd93-3997fcf8dc43 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a46d18160148f3a48ef4887f6ec7da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6284f2b80524eb0a36ccebaedba767a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:15.633175 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-62c2988c-758a-4453-bd93-3997fcf8dc43 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "GET /compute/v2.1/servers/4c526cd8-5f97-4b6f-af6a-ab22442bf0d6" status: 200 len: 1318 microversion: 2.1 time: 0.632494 Feb 17 04:38:15.633985 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 137/280] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:14 2021] GET /compute/v2.1/servers/4c526cd8-5f97-4b6f-af6a-ab22442bf0d6 => generated 1318 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:15.722495 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-09c8a30a-052e-49fa-b0e2-eb526c6fc44d tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:15.735447 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-09c8a30a-052e-49fa-b0e2-eb526c6fc44d tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c" status: 200 len: 1516 microversion: 2.1 time: 0.325866 Feb 17 04:38:15.736078 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 144/281] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:15 2021] GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c => generated 1516 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:16.178930 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-6ec221e8-f5d5-4b11-95f3-32cc883fed44 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:16.180834 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-6ec221e8-f5d5-4b11-95f3-32cc883fed44 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:16.193030 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6ec221e8-f5d5-4b11-95f3-32cc883fed44 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:16.193719 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6ec221e8-f5d5-4b11-95f3-32cc883fed44 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:16.194916 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6ec221e8-f5d5-4b11-95f3-32cc883fed44 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:16.196013 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6ec221e8-f5d5-4b11-95f3-32cc883fed44 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:16.429239 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-c197087b-aa9a-4d15-a5df-e8761fa5c05e tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:16.430413 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-c197087b-aa9a-4d15-a5df-e8761fa5c05e tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] [instance: d9d6e198-85f5-488e-8317-d498205f37cc] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:16.453293 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c197087b-aa9a-4d15-a5df-e8761fa5c05e tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:16.456329 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c197087b-aa9a-4d15-a5df-e8761fa5c05e tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:16.457552 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c197087b-aa9a-4d15-a5df-e8761fa5c05e tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:16.471079 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c197087b-aa9a-4d15-a5df-e8761fa5c05e tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:16.479294 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-6ec221e8-f5d5-4b11-95f3-32cc883fed44 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "POST /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/action" status: 200 len: 30606 microversion: 2.20 time: 0.290139 Feb 17 04:38:16.484950 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 138/282] 10.222.0.38 () {62 vars in 1309 bytes} [Wed Feb 17 04:38:16 2021] POST /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/action => generated 30606 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:38:16.655137 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-eae04ad3-296e-4281-986c-c0d630926fd7 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:16.657061 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-eae04ad3-296e-4281-986c-c0d630926fd7 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: 4c526cd8-5f97-4b6f-af6a-ab22442bf0d6] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:16.671193 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-eae04ad3-296e-4281-986c-c0d630926fd7 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:16.672033 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-eae04ad3-296e-4281-986c-c0d630926fd7 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:16.673254 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-eae04ad3-296e-4281-986c-c0d630926fd7 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:16.673858 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-eae04ad3-296e-4281-986c-c0d630926fd7 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:16.733601 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-c197087b-aa9a-4d15-a5df-e8761fa5c05e tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a3efaa75e64645abf7555ccfe348d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b23386679f44b7e9d4204ab1e9adf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:16.750395 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-c197087b-aa9a-4d15-a5df-e8761fa5c05e tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] 10.222.0.38 "GET /compute/v2.1/servers/d9d6e198-85f5-488e-8317-d498205f37cc" status: 200 len: 1276 microversion: 2.1 time: 0.329226 Feb 17 04:38:16.751289 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 145/283] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:16 2021] GET /compute/v2.1/servers/d9d6e198-85f5-488e-8317-d498205f37cc => generated 1276 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:17.232270 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-eae04ad3-296e-4281-986c-c0d630926fd7 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a46d18160148f3a48ef4887f6ec7da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6284f2b80524eb0a36ccebaedba767a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:17.266604 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-eae04ad3-296e-4281-986c-c0d630926fd7 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "GET /compute/v2.1/servers/4c526cd8-5f97-4b6f-af6a-ab22442bf0d6" status: 200 len: 1318 microversion: 2.1 time: 0.617720 Feb 17 04:38:17.270028 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 139/284] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:16 2021] GET /compute/v2.1/servers/4c526cd8-5f97-4b6f-af6a-ab22442bf0d6 => generated 1318 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:17.492107 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-324fb76c-736c-415c-aa1f-fb713e155e11 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:17.493388 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-324fb76c-736c-415c-aa1f-fb713e155e11 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:17.511210 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-324fb76c-736c-415c-aa1f-fb713e155e11 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:17.511721 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-324fb76c-736c-415c-aa1f-fb713e155e11 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:17.512575 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-324fb76c-736c-415c-aa1f-fb713e155e11 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:17.513068 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-324fb76c-736c-415c-aa1f-fb713e155e11 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:17.689706 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-44d2ecc8-6aea-4927-bf63-ab5ba9238cac tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:17.690814 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-44d2ecc8-6aea-4927-bf63-ab5ba9238cac tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 68a5c561-c418-4a68-b8b3-1600b638b80c] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:17.709155 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-44d2ecc8-6aea-4927-bf63-ab5ba9238cac tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:17.709645 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-44d2ecc8-6aea-4927-bf63-ab5ba9238cac tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:17.714129 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-44d2ecc8-6aea-4927-bf63-ab5ba9238cac tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:17.716947 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-44d2ecc8-6aea-4927-bf63-ab5ba9238cac tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:17.744140 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-324fb76c-736c-415c-aa1f-fb713e155e11 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "POST /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/action" status: 200 len: 31481 microversion: 2.20 time: 0.255957 Feb 17 04:38:17.745455 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 146/285] 10.222.0.38 () {62 vars in 1309 bytes} [Wed Feb 17 04:38:17 2021] POST /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/action => generated 31481 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:38:17.770980 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-25fc3853-eb5f-48d3-b51c-9e9a973f271e tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:17.771737 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-25fc3853-eb5f-48d3-b51c-9e9a973f271e tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] [instance: d9d6e198-85f5-488e-8317-d498205f37cc] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:17.786977 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-25fc3853-eb5f-48d3-b51c-9e9a973f271e tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:17.790790 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-25fc3853-eb5f-48d3-b51c-9e9a973f271e tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:17.798012 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-25fc3853-eb5f-48d3-b51c-9e9a973f271e tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:17.798493 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-25fc3853-eb5f-48d3-b51c-9e9a973f271e tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:17.847622 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.objects.instance [None req-44d2ecc8-6aea-4927-bf63-ab5ba9238cac tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lazy-loading 'flavor' on Instance uuid 68a5c561-c418-4a68-b8b3-1600b638b80c {{(pid=98081) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:38:17.966139 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-25fc3853-eb5f-48d3-b51c-9e9a973f271e tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a3efaa75e64645abf7555ccfe348d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b23386679f44b7e9d4204ab1e9adf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:17.983326 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-25fc3853-eb5f-48d3-b51c-9e9a973f271e tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] 10.222.0.38 "GET /compute/v2.1/servers/d9d6e198-85f5-488e-8317-d498205f37cc" status: 200 len: 1276 microversion: 2.1 time: 0.216714 Feb 17 04:38:17.984227 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 147/286] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:17 2021] GET /compute/v2.1/servers/d9d6e198-85f5-488e-8317-d498205f37cc => generated 1276 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:18.065729 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-44d2ecc8-6aea-4927-bf63-ab5ba9238cac tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "POST /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c/action" status: 200 len: 32 microversion: 2.1 time: 0.385987 Feb 17 04:38:18.066589 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 140/287] 10.222.0.38 () {60 vars in 1268 bytes} [Wed Feb 17 04:38:17 2021] POST /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c/action => generated 32 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:38:18.076149 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-659614f9-6a41-4609-bc1f-0fa7e818c330 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:18.076837 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-659614f9-6a41-4609-bc1f-0fa7e818c330 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 68a5c561-c418-4a68-b8b3-1600b638b80c] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:18.085219 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-659614f9-6a41-4609-bc1f-0fa7e818c330 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:18.085718 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-659614f9-6a41-4609-bc1f-0fa7e818c330 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:18.086809 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-659614f9-6a41-4609-bc1f-0fa7e818c330 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:18.087292 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-659614f9-6a41-4609-bc1f-0fa7e818c330 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:18.288192 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-67cfeba6-f08f-45b3-a0cb-4b8348e9376a tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:18.288945 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-67cfeba6-f08f-45b3-a0cb-4b8348e9376a tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: 4c526cd8-5f97-4b6f-af6a-ab22442bf0d6] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:18.297724 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-67cfeba6-f08f-45b3-a0cb-4b8348e9376a tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:18.298862 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-67cfeba6-f08f-45b3-a0cb-4b8348e9376a tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:18.300179 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-67cfeba6-f08f-45b3-a0cb-4b8348e9376a tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:18.300913 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-67cfeba6-f08f-45b3-a0cb-4b8348e9376a tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:18.784408 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-659614f9-6a41-4609-bc1f-0fa7e818c330 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:18.810547 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-67cfeba6-f08f-45b3-a0cb-4b8348e9376a tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a46d18160148f3a48ef4887f6ec7da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6284f2b80524eb0a36ccebaedba767a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:18.816199 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-659614f9-6a41-4609-bc1f-0fa7e818c330 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c" status: 200 len: 1522 microversion: 2.1 time: 0.731795 Feb 17 04:38:18.817265 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 148/288] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:18 2021] GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c => generated 1522 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:18.823099 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-67cfeba6-f08f-45b3-a0cb-4b8348e9376a tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "GET /compute/v2.1/servers/4c526cd8-5f97-4b6f-af6a-ab22442bf0d6" status: 200 len: 1508 microversion: 2.1 time: 0.539398 Feb 17 04:38:18.823685 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 141/289] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:18 2021] GET /compute/v2.1/servers/4c526cd8-5f97-4b6f-af6a-ab22442bf0d6 => generated 1508 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:18.834791 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-03c2d341-c4b9-4361-929d-b790819a5c23 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:18.834791 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-03c2d341-c4b9-4361-929d-b790819a5c23 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:18.843361 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-03c2d341-c4b9-4361-929d-b790819a5c23 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:18.844097 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-03c2d341-c4b9-4361-929d-b790819a5c23 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:18.845168 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-03c2d341-c4b9-4361-929d-b790819a5c23 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:18.845849 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-03c2d341-c4b9-4361-929d-b790819a5c23 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:19.001679 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-70ab3d9d-100c-41a8-8f92-46129735bacb tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:19.002347 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-70ab3d9d-100c-41a8-8f92-46129735bacb tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] [instance: d9d6e198-85f5-488e-8317-d498205f37cc] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:19.012086 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-70ab3d9d-100c-41a8-8f92-46129735bacb tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:19.012574 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-70ab3d9d-100c-41a8-8f92-46129735bacb tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:19.013597 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-70ab3d9d-100c-41a8-8f92-46129735bacb tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:19.014239 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-70ab3d9d-100c-41a8-8f92-46129735bacb tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:19.319176 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-70ab3d9d-100c-41a8-8f92-46129735bacb tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a3efaa75e64645abf7555ccfe348d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b23386679f44b7e9d4204ab1e9adf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:19.333082 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-70ab3d9d-100c-41a8-8f92-46129735bacb tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] 10.222.0.38 "GET /compute/v2.1/servers/d9d6e198-85f5-488e-8317-d498205f37cc" status: 200 len: 1318 microversion: 2.1 time: 0.335099 Feb 17 04:38:19.333599 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 142/290] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:18 2021] GET /compute/v2.1/servers/d9d6e198-85f5-488e-8317-d498205f37cc => generated 1318 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:19.836197 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-c92edc7a-61ff-4ab2-bfcf-5127cfcacc20 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:19.836864 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-c92edc7a-61ff-4ab2-bfcf-5127cfcacc20 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 68a5c561-c418-4a68-b8b3-1600b638b80c] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:19.845692 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c92edc7a-61ff-4ab2-bfcf-5127cfcacc20 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:19.846262 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c92edc7a-61ff-4ab2-bfcf-5127cfcacc20 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:19.847203 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c92edc7a-61ff-4ab2-bfcf-5127cfcacc20 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:19.847672 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c92edc7a-61ff-4ab2-bfcf-5127cfcacc20 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:20.099832 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-c92edc7a-61ff-4ab2-bfcf-5127cfcacc20 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:20.109461 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-c92edc7a-61ff-4ab2-bfcf-5127cfcacc20 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c" status: 200 len: 1522 microversion: 2.1 time: 0.277949 Feb 17 04:38:20.110619 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 143/291] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:19 2021] GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c => generated 1522 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:38:20.351906 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-4e319bdb-bae6-4d9e-b750-64414f4f6953 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:20.352617 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-4e319bdb-bae6-4d9e-b750-64414f4f6953 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] [instance: d9d6e198-85f5-488e-8317-d498205f37cc] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:20.360480 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4e319bdb-bae6-4d9e-b750-64414f4f6953 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:20.361011 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4e319bdb-bae6-4d9e-b750-64414f4f6953 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:20.361834 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4e319bdb-bae6-4d9e-b750-64414f4f6953 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:20.362332 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4e319bdb-bae6-4d9e-b750-64414f4f6953 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:20.580195 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-4e319bdb-bae6-4d9e-b750-64414f4f6953 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a3efaa75e64645abf7555ccfe348d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b23386679f44b7e9d4204ab1e9adf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:20.589504 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-4e319bdb-bae6-4d9e-b750-64414f4f6953 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] 10.222.0.38 "GET /compute/v2.1/servers/d9d6e198-85f5-488e-8317-d498205f37cc" status: 200 len: 1318 microversion: 2.1 time: 0.242365 Feb 17 04:38:20.590103 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 144/292] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:20 2021] GET /compute/v2.1/servers/d9d6e198-85f5-488e-8317-d498205f37cc => generated 1318 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:38:21.127820 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-aa53f789-fa42-4dc3-ae32-2f464fe7be49 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:21.128744 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-aa53f789-fa42-4dc3-ae32-2f464fe7be49 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 68a5c561-c418-4a68-b8b3-1600b638b80c] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:21.137275 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-aa53f789-fa42-4dc3-ae32-2f464fe7be49 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:21.137832 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-aa53f789-fa42-4dc3-ae32-2f464fe7be49 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:21.138766 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-aa53f789-fa42-4dc3-ae32-2f464fe7be49 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:21.139271 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-aa53f789-fa42-4dc3-ae32-2f464fe7be49 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:21.194138 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-03c2d341-c4b9-4361-929d-b790819a5c23 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "POST /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/action" status: 200 len: 33244 microversion: 2.20 time: 2.375131 Feb 17 04:38:21.195239 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 149/293] 10.222.0.38 () {62 vars in 1309 bytes} [Wed Feb 17 04:38:18 2021] POST /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/action => generated 33244 bytes in 2377 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:38:21.609404 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-78c0b86c-b746-46eb-8953-da5433a31104 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:21.610187 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-78c0b86c-b746-46eb-8953-da5433a31104 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] [instance: d9d6e198-85f5-488e-8317-d498205f37cc] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:21.620101 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-78c0b86c-b746-46eb-8953-da5433a31104 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:21.620701 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-78c0b86c-b746-46eb-8953-da5433a31104 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:21.621552 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-78c0b86c-b746-46eb-8953-da5433a31104 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:21.622043 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-78c0b86c-b746-46eb-8953-da5433a31104 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:21.780518 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-aa53f789-fa42-4dc3-ae32-2f464fe7be49 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:21.795648 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-aa53f789-fa42-4dc3-ae32-2f464fe7be49 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c" status: 200 len: 1522 microversion: 2.1 time: 0.671693 Feb 17 04:38:21.797255 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 145/294] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:21 2021] GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c => generated 1522 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:38:22.207889 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-4352d0da-a0f0-4ff8-b72e-262a9a27ddf8 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:22.209292 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-4352d0da-a0f0-4ff8-b72e-262a9a27ddf8 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:22.217501 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4352d0da-a0f0-4ff8-b72e-262a9a27ddf8 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:22.218350 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4352d0da-a0f0-4ff8-b72e-262a9a27ddf8 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:22.219367 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4352d0da-a0f0-4ff8-b72e-262a9a27ddf8 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:22.220007 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4352d0da-a0f0-4ff8-b72e-262a9a27ddf8 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:22.333938 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-78c0b86c-b746-46eb-8953-da5433a31104 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a3efaa75e64645abf7555ccfe348d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b23386679f44b7e9d4204ab1e9adf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:22.344687 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-78c0b86c-b746-46eb-8953-da5433a31104 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] 10.222.0.38 "GET /compute/v2.1/servers/d9d6e198-85f5-488e-8317-d498205f37cc" status: 200 len: 1318 microversion: 2.1 time: 0.740213 Feb 17 04:38:22.345425 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 150/295] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:21 2021] GET /compute/v2.1/servers/d9d6e198-85f5-488e-8317-d498205f37cc => generated 1318 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:38:22.377715 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-4352d0da-a0f0-4ff8-b72e-262a9a27ddf8 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "POST /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/action" status: 200 len: 33696 microversion: 2.20 time: 0.173919 Feb 17 04:38:22.378646 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 146/296] 10.222.0.38 () {62 vars in 1309 bytes} [Wed Feb 17 04:38:22 2021] POST /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/action => generated 33696 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:38:22.701307 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-7c68c9b3-9dcc-4070-9b69-31bad22993a0 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ef395a02-48d5-40a1-a56d-662d46faea6b"}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:22.702499 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-7c68c9b3-9dcc-4070-9b69-31bad22993a0 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: 4c526cd8-5f97-4b6f-af6a-ab22442bf0d6] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:22.712232 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7c68c9b3-9dcc-4070-9b69-31bad22993a0 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:22.712927 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7c68c9b3-9dcc-4070-9b69-31bad22993a0 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:22.713958 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7c68c9b3-9dcc-4070-9b69-31bad22993a0 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:22.714638 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7c68c9b3-9dcc-4070-9b69-31bad22993a0 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:22.816290 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-9b53a75b-2c04-4c9b-a9c3-db90d0d9263e tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:22.817161 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-9b53a75b-2c04-4c9b-a9c3-db90d0d9263e tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 68a5c561-c418-4a68-b8b3-1600b638b80c] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:22.826429 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9b53a75b-2c04-4c9b-a9c3-db90d0d9263e tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:22.827277 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9b53a75b-2c04-4c9b-a9c3-db90d0d9263e tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:22.828314 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9b53a75b-2c04-4c9b-a9c3-db90d0d9263e tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:22.829275 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9b53a75b-2c04-4c9b-a9c3-db90d0d9263e tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:23.202222 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-7c68c9b3-9dcc-4070-9b69-31bad22993a0 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "POST /compute/v2.1/servers/4c526cd8-5f97-4b6f-af6a-ab22442bf0d6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.504707 Feb 17 04:38:23.202991 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 151/297] 10.222.0.38 () {60 vars in 1313 bytes} [Wed Feb 17 04:38:22 2021] POST /compute/v2.1/servers/4c526cd8-5f97-4b6f-af6a-ab22442bf0d6/os-volume_attachments => generated 194 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:38:23.369500 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-5c3a9827-7a20-4341-ab90-a6ac07a2b1be tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:23.369500 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-5c3a9827-7a20-4341-ab90-a6ac07a2b1be tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] [instance: d9d6e198-85f5-488e-8317-d498205f37cc] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:23.384387 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5c3a9827-7a20-4341-ab90-a6ac07a2b1be tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:23.385007 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5c3a9827-7a20-4341-ab90-a6ac07a2b1be tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:23.385976 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5c3a9827-7a20-4341-ab90-a6ac07a2b1be tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:23.386604 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5c3a9827-7a20-4341-ab90-a6ac07a2b1be tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:23.464728 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-9b53a75b-2c04-4c9b-a9c3-db90d0d9263e tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:23.479213 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-9b53a75b-2c04-4c9b-a9c3-db90d0d9263e tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c" status: 200 len: 1522 microversion: 2.1 time: 0.668086 Feb 17 04:38:23.480418 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 147/298] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:22 2021] GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c => generated 1522 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:38:23.485519 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-13707312-0e57-49f7-863e-bdae5c3c009e tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:23.486772 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-13707312-0e57-49f7-863e-bdae5c3c009e tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:23.499807 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-13707312-0e57-49f7-863e-bdae5c3c009e tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:23.500312 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-13707312-0e57-49f7-863e-bdae5c3c009e tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:23.501170 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-13707312-0e57-49f7-863e-bdae5c3c009e tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:23.501680 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-13707312-0e57-49f7-863e-bdae5c3c009e tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:23.882034 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-5c3a9827-7a20-4341-ab90-a6ac07a2b1be tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a3efaa75e64645abf7555ccfe348d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b23386679f44b7e9d4204ab1e9adf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:23.891118 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-5c3a9827-7a20-4341-ab90-a6ac07a2b1be tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] 10.222.0.38 "GET /compute/v2.1/servers/d9d6e198-85f5-488e-8317-d498205f37cc" status: 200 len: 1318 microversion: 2.1 time: 0.531370 Feb 17 04:38:23.891743 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 152/299] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:23 2021] GET /compute/v2.1/servers/d9d6e198-85f5-488e-8317-d498205f37cc => generated 1318 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:23.930363 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [req-8b5c38d8-3e2e-42ed-b725-b873cdcb1dd0 req-b13249dc-c717-42d4-ae7a-82b2e7d3f944 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9d6e198-85f5-488e-8317-d498205f37cc", "tag": "5d940ae4-3a6b-4f9e-94a7-67aabf2dbacb"}]} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:23.932226 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:38:23.932226 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:38:23.941693 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-8b5c38d8-3e2e-42ed-b725-b873cdcb1dd0 req-b13249dc-c717-42d4-ae7a-82b2e7d3f944 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:23.942149 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-8b5c38d8-3e2e-42ed-b725-b873cdcb1dd0 req-b13249dc-c717-42d4-ae7a-82b2e7d3f944 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:23.959648 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.compute.server_external_events [req-8b5c38d8-3e2e-42ed-b725-b873cdcb1dd0 req-b13249dc-c717-42d4-ae7a-82b2e7d3f944 service nova] Creating event network-changed:5d940ae4-3a6b-4f9e-94a7-67aabf2dbacb for instance d9d6e198-85f5-488e-8317-d498205f37cc on hv-cinder-76019 Feb 17 04:38:23.964615 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [req-8b5c38d8-3e2e-42ed-b725-b873cdcb1dd0 req-b13249dc-c717-42d4-ae7a-82b2e7d3f944 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038823 Feb 17 04:38:23.965263 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 153/300] 10.222.0.38 () {64 vars in 1308 bytes} [Wed Feb 17 04:38:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:38:24.514684 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-841bec14-0627-4dc9-87ba-9128cf9b649a tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:24.515460 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-841bec14-0627-4dc9-87ba-9128cf9b649a tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 68a5c561-c418-4a68-b8b3-1600b638b80c] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:24.524515 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-841bec14-0627-4dc9-87ba-9128cf9b649a tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:24.524793 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-841bec14-0627-4dc9-87ba-9128cf9b649a tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:24.525583 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-841bec14-0627-4dc9-87ba-9128cf9b649a tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:24.526078 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-841bec14-0627-4dc9-87ba-9128cf9b649a tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:24.746224 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-841bec14-0627-4dc9-87ba-9128cf9b649a tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:24.755638 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-841bec14-0627-4dc9-87ba-9128cf9b649a tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c" status: 200 len: 1522 microversion: 2.1 time: 0.246152 Feb 17 04:38:24.756238 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 154/301] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:24 2021] GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c => generated 1522 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:24.909232 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-da3b25ab-baf9-44d9-ab0f-dbe493cb6625 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:24.909831 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-da3b25ab-baf9-44d9-ab0f-dbe493cb6625 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] [instance: d9d6e198-85f5-488e-8317-d498205f37cc] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:24.917999 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-da3b25ab-baf9-44d9-ab0f-dbe493cb6625 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:24.918507 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-da3b25ab-baf9-44d9-ab0f-dbe493cb6625 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:24.919418 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-da3b25ab-baf9-44d9-ab0f-dbe493cb6625 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:24.919915 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-da3b25ab-baf9-44d9-ab0f-dbe493cb6625 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:25.131023 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-da3b25ab-baf9-44d9-ab0f-dbe493cb6625 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a3efaa75e64645abf7555ccfe348d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b23386679f44b7e9d4204ab1e9adf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:25.140666 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-da3b25ab-baf9-44d9-ab0f-dbe493cb6625 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] 10.222.0.38 "GET /compute/v2.1/servers/d9d6e198-85f5-488e-8317-d498205f37cc" status: 200 len: 1318 microversion: 2.1 time: 0.235039 Feb 17 04:38:25.142274 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 155/302] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:24 2021] GET /compute/v2.1/servers/d9d6e198-85f5-488e-8317-d498205f37cc => generated 1318 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:38:25.773449 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-530655b1-992a-4b0a-9d0b-1d695b48c378 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:25.774109 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-530655b1-992a-4b0a-9d0b-1d695b48c378 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 68a5c561-c418-4a68-b8b3-1600b638b80c] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:25.781869 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-530655b1-992a-4b0a-9d0b-1d695b48c378 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:25.782370 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-530655b1-992a-4b0a-9d0b-1d695b48c378 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:25.783246 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-530655b1-992a-4b0a-9d0b-1d695b48c378 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:25.783740 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-530655b1-992a-4b0a-9d0b-1d695b48c378 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:25.996529 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-530655b1-992a-4b0a-9d0b-1d695b48c378 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:26.005722 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-530655b1-992a-4b0a-9d0b-1d695b48c378 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c" status: 200 len: 1522 microversion: 2.1 time: 0.236194 Feb 17 04:38:26.006491 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 156/303] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:25 2021] GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:38:26.157953 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-bf767f10-d4cf-400e-b6fb-119078420ed2 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:26.158634 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-bf767f10-d4cf-400e-b6fb-119078420ed2 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] [instance: d9d6e198-85f5-488e-8317-d498205f37cc] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:26.166867 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-bf767f10-d4cf-400e-b6fb-119078420ed2 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:26.167367 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-bf767f10-d4cf-400e-b6fb-119078420ed2 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:26.168192 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-bf767f10-d4cf-400e-b6fb-119078420ed2 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:26.168680 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-bf767f10-d4cf-400e-b6fb-119078420ed2 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:26.305988 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-13707312-0e57-49f7-863e-bdae5c3c009e tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "POST /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/action" status: 200 len: 35454 microversion: 2.20 time: 2.823934 Feb 17 04:38:26.307776 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 148/304] 10.222.0.38 () {62 vars in 1309 bytes} [Wed Feb 17 04:38:23 2021] POST /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/action => generated 35454 bytes in 2827 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:38:26.556359 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-bf767f10-d4cf-400e-b6fb-119078420ed2 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a3efaa75e64645abf7555ccfe348d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b23386679f44b7e9d4204ab1e9adf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:26.565557 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-bf767f10-d4cf-400e-b6fb-119078420ed2 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] 10.222.0.38 "GET /compute/v2.1/servers/d9d6e198-85f5-488e-8317-d498205f37cc" status: 200 len: 1318 microversion: 2.1 time: 0.411384 Feb 17 04:38:26.566391 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 157/305] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:26 2021] GET /compute/v2.1/servers/d9d6e198-85f5-488e-8317-d498205f37cc => generated 1318 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:38:27.024717 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-16f7f10c-8ab4-4c0f-a83e-e62e28dc61d9 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:27.025686 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-16f7f10c-8ab4-4c0f-a83e-e62e28dc61d9 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 68a5c561-c418-4a68-b8b3-1600b638b80c] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:27.037045 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-16f7f10c-8ab4-4c0f-a83e-e62e28dc61d9 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:27.037568 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-16f7f10c-8ab4-4c0f-a83e-e62e28dc61d9 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:27.038445 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-16f7f10c-8ab4-4c0f-a83e-e62e28dc61d9 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:27.039048 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-16f7f10c-8ab4-4c0f-a83e-e62e28dc61d9 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:27.318993 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-ab8c6b03-b483-4b86-ba6a-ded0d176d264 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:27.320699 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-ab8c6b03-b483-4b86-ba6a-ded0d176d264 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:27.337300 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ab8c6b03-b483-4b86-ba6a-ded0d176d264 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:27.338062 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ab8c6b03-b483-4b86-ba6a-ded0d176d264 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:27.339017 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ab8c6b03-b483-4b86-ba6a-ded0d176d264 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:27.339569 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ab8c6b03-b483-4b86-ba6a-ded0d176d264 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:27.469946 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-ab8c6b03-b483-4b86-ba6a-ded0d176d264 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "POST /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/action" status: 200 len: 36330 microversion: 2.20 time: 0.154904 Feb 17 04:38:27.471551 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 158/306] 10.222.0.38 () {62 vars in 1309 bytes} [Wed Feb 17 04:38:27 2021] POST /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/action => generated 36330 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 04:38:27.478741 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-16f7f10c-8ab4-4c0f-a83e-e62e28dc61d9 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:27.487872 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-16f7f10c-8ab4-4c0f-a83e-e62e28dc61d9 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c" status: 200 len: 1522 microversion: 2.1 time: 0.467893 Feb 17 04:38:27.489199 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 149/307] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:27 2021] GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c => generated 1522 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:27.584324 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-f23292e1-5882-435c-9193-c04580d75b6b tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:27.585337 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-f23292e1-5882-435c-9193-c04580d75b6b tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] [instance: d9d6e198-85f5-488e-8317-d498205f37cc] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:27.593801 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f23292e1-5882-435c-9193-c04580d75b6b tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:27.594306 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f23292e1-5882-435c-9193-c04580d75b6b tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:27.595310 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f23292e1-5882-435c-9193-c04580d75b6b tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:27.595798 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f23292e1-5882-435c-9193-c04580d75b6b tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:27.827357 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-f23292e1-5882-435c-9193-c04580d75b6b tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a3efaa75e64645abf7555ccfe348d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b23386679f44b7e9d4204ab1e9adf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:27.839056 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-f23292e1-5882-435c-9193-c04580d75b6b tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] 10.222.0.38 "GET /compute/v2.1/servers/d9d6e198-85f5-488e-8317-d498205f37cc" status: 200 len: 1318 microversion: 2.1 time: 0.259311 Feb 17 04:38:27.839793 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 159/308] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:27 2021] GET /compute/v2.1/servers/d9d6e198-85f5-488e-8317-d498205f37cc => generated 1318 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:28.484027 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-5a1d5a3c-3f6c-4dab-8323-e8d0687e816f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:28.485110 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-5a1d5a3c-3f6c-4dab-8323-e8d0687e816f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:28.497559 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5a1d5a3c-3f6c-4dab-8323-e8d0687e816f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:28.498071 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5a1d5a3c-3f6c-4dab-8323-e8d0687e816f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:28.498948 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5a1d5a3c-3f6c-4dab-8323-e8d0687e816f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:28.499448 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5a1d5a3c-3f6c-4dab-8323-e8d0687e816f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:28.507220 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-a34accbd-322b-420c-a1da-415e33c7ea96 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:28.507937 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-a34accbd-322b-420c-a1da-415e33c7ea96 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 68a5c561-c418-4a68-b8b3-1600b638b80c] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:28.515752 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a34accbd-322b-420c-a1da-415e33c7ea96 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:28.516261 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a34accbd-322b-420c-a1da-415e33c7ea96 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:28.517090 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a34accbd-322b-420c-a1da-415e33c7ea96 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:28.517579 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a34accbd-322b-420c-a1da-415e33c7ea96 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:28.633448 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-5a1d5a3c-3f6c-4dab-8323-e8d0687e816f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "POST /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/action" status: 200 len: 37078 microversion: 2.20 time: 0.153753 Feb 17 04:38:28.634076 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 150/309] 10.222.0.38 () {62 vars in 1309 bytes} [Wed Feb 17 04:38:28 2021] POST /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/action => generated 37078 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 04:38:28.737941 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-a34accbd-322b-420c-a1da-415e33c7ea96 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:28.747232 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-a34accbd-322b-420c-a1da-415e33c7ea96 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c" status: 200 len: 1522 microversion: 2.1 time: 0.244788 Feb 17 04:38:28.747883 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 160/310] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:28 2021] GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c => generated 1522 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:28.858410 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-8b1ecb3f-9b4b-4d4a-9736-2523422531e0 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:28.859215 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-8b1ecb3f-9b4b-4d4a-9736-2523422531e0 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] [instance: d9d6e198-85f5-488e-8317-d498205f37cc] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:28.868657 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8b1ecb3f-9b4b-4d4a-9736-2523422531e0 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:28.869395 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8b1ecb3f-9b4b-4d4a-9736-2523422531e0 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:28.870253 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8b1ecb3f-9b4b-4d4a-9736-2523422531e0 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:28.870801 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8b1ecb3f-9b4b-4d4a-9736-2523422531e0 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:29.099478 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-8b1ecb3f-9b4b-4d4a-9736-2523422531e0 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a3efaa75e64645abf7555ccfe348d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b23386679f44b7e9d4204ab1e9adf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:29.108856 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-8b1ecb3f-9b4b-4d4a-9736-2523422531e0 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] 10.222.0.38 "GET /compute/v2.1/servers/d9d6e198-85f5-488e-8317-d498205f37cc" status: 200 len: 1318 microversion: 2.1 time: 0.255125 Feb 17 04:38:29.109449 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 151/311] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:28 2021] GET /compute/v2.1/servers/d9d6e198-85f5-488e-8317-d498205f37cc => generated 1318 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:29.656837 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-03267208-62c6-4ba8-9bbf-3bcf6712b645 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:29.657827 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-03267208-62c6-4ba8-9bbf-3bcf6712b645 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:29.671021 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-03267208-62c6-4ba8-9bbf-3bcf6712b645 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:29.671525 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-03267208-62c6-4ba8-9bbf-3bcf6712b645 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:29.672515 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-03267208-62c6-4ba8-9bbf-3bcf6712b645 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:29.673174 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-03267208-62c6-4ba8-9bbf-3bcf6712b645 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:29.765546 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-c3b1fa20-e13f-46db-87e5-41e22e127c4f tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:29.766692 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-c3b1fa20-e13f-46db-87e5-41e22e127c4f tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 68a5c561-c418-4a68-b8b3-1600b638b80c] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:29.776124 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c3b1fa20-e13f-46db-87e5-41e22e127c4f tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:29.776932 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c3b1fa20-e13f-46db-87e5-41e22e127c4f tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:29.777973 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c3b1fa20-e13f-46db-87e5-41e22e127c4f tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:29.780995 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c3b1fa20-e13f-46db-87e5-41e22e127c4f tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:29.819640 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-03267208-62c6-4ba8-9bbf-3bcf6712b645 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "POST /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/action" status: 200 len: 38158 microversion: 2.20 time: 0.175144 Feb 17 04:38:29.821158 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 161/312] 10.222.0.38 () {62 vars in 1309 bytes} [Wed Feb 17 04:38:29 2021] POST /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/action => generated 38158 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:38:30.033187 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-c3b1fa20-e13f-46db-87e5-41e22e127c4f tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:30.042761 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-c3b1fa20-e13f-46db-87e5-41e22e127c4f tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c" status: 200 len: 1522 microversion: 2.1 time: 0.281255 Feb 17 04:38:30.043462 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 152/313] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:29 2021] GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c => generated 1522 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:30.128646 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-da5f08b9-8312-42c2-85ee-0379d6dce0f1 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:30.129837 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-da5f08b9-8312-42c2-85ee-0379d6dce0f1 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] [instance: d9d6e198-85f5-488e-8317-d498205f37cc] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:30.138451 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-da5f08b9-8312-42c2-85ee-0379d6dce0f1 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:30.139014 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-da5f08b9-8312-42c2-85ee-0379d6dce0f1 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:30.139861 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-da5f08b9-8312-42c2-85ee-0379d6dce0f1 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:30.140360 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-da5f08b9-8312-42c2-85ee-0379d6dce0f1 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:30.358526 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-da5f08b9-8312-42c2-85ee-0379d6dce0f1 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a3efaa75e64645abf7555ccfe348d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b23386679f44b7e9d4204ab1e9adf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:30.368222 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-da5f08b9-8312-42c2-85ee-0379d6dce0f1 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] 10.222.0.38 "GET /compute/v2.1/servers/d9d6e198-85f5-488e-8317-d498205f37cc" status: 200 len: 1318 microversion: 2.1 time: 0.244178 Feb 17 04:38:30.368895 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 162/314] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:30 2021] GET /compute/v2.1/servers/d9d6e198-85f5-488e-8317-d498205f37cc => generated 1318 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:30.833531 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-cf7ab70a-a371-44aa-ad8c-6bffec0e600e tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:30.834684 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-cf7ab70a-a371-44aa-ad8c-6bffec0e600e tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:30.846346 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-cf7ab70a-a371-44aa-ad8c-6bffec0e600e tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:30.849122 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-cf7ab70a-a371-44aa-ad8c-6bffec0e600e tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:30.849122 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-cf7ab70a-a371-44aa-ad8c-6bffec0e600e tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:30.849332 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-cf7ab70a-a371-44aa-ad8c-6bffec0e600e tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:30.989345 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-cf7ab70a-a371-44aa-ad8c-6bffec0e600e tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "POST /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/action" status: 200 len: 38334 microversion: 2.20 time: 0.160276 Feb 17 04:38:30.990280 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 153/315] 10.222.0.38 () {62 vars in 1309 bytes} [Wed Feb 17 04:38:30 2021] POST /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/action => generated 38334 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:38:31.001880 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-c869f7f6-8527-4936-8d7f-cee3937043ad tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:31.002810 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-c869f7f6-8527-4936-8d7f-cee3937043ad tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:31.011057 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c869f7f6-8527-4936-8d7f-cee3937043ad tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:31.012258 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c869f7f6-8527-4936-8d7f-cee3937043ad tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:31.013433 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c869f7f6-8527-4936-8d7f-cee3937043ad tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:31.014113 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c869f7f6-8527-4936-8d7f-cee3937043ad tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:31.062451 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-c4cc1ac3-1a55-42bb-88bf-9e729f4f0525 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:31.063385 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-c4cc1ac3-1a55-42bb-88bf-9e729f4f0525 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 68a5c561-c418-4a68-b8b3-1600b638b80c] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:31.086859 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c4cc1ac3-1a55-42bb-88bf-9e729f4f0525 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:31.087701 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c4cc1ac3-1a55-42bb-88bf-9e729f4f0525 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:31.088739 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c4cc1ac3-1a55-42bb-88bf-9e729f4f0525 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:31.089515 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c4cc1ac3-1a55-42bb-88bf-9e729f4f0525 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:31.095151 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-c869f7f6-8527-4936-8d7f-cee3937043ad tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/ips" status: 200 len: 152 microversion: 2.20 time: 0.097857 Feb 17 04:38:31.096873 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 163/316] 10.222.0.38 () {60 vars in 1279 bytes} [Wed Feb 17 04:38:30 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/ips => generated 152 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 04:38:31.336066 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-c4cc1ac3-1a55-42bb-88bf-9e729f4f0525 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:31.345682 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-c4cc1ac3-1a55-42bb-88bf-9e729f4f0525 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c" status: 200 len: 1522 microversion: 2.1 time: 0.288033 Feb 17 04:38:31.346280 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 154/317] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:31 2021] GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c => generated 1522 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:31.395830 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-a3956244-5bb2-4081-b041-a625288a1aa0 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:31.397044 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-a3956244-5bb2-4081-b041-a625288a1aa0 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] [instance: d9d6e198-85f5-488e-8317-d498205f37cc] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:31.412273 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a3956244-5bb2-4081-b041-a625288a1aa0 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:31.413141 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a3956244-5bb2-4081-b041-a625288a1aa0 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:31.414542 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a3956244-5bb2-4081-b041-a625288a1aa0 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:31.415407 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a3956244-5bb2-4081-b041-a625288a1aa0 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:31.674073 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [req-1ebad78e-d1d0-4229-95d8-206e7ed7edee req-a5d9ebf4-3484-47d5-9204-b862ee194a1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9d6e198-85f5-488e-8317-d498205f37cc", "name": "network-vif-plugged", "status": "completed", "tag": "5d940ae4-3a6b-4f9e-94a7-67aabf2dbacb"}]} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:31.675932 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:38:31.675932 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:38:31.686609 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-a3956244-5bb2-4081-b041-a625288a1aa0 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a3efaa75e64645abf7555ccfe348d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b23386679f44b7e9d4204ab1e9adf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:31.697443 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-a3956244-5bb2-4081-b041-a625288a1aa0 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] 10.222.0.38 "GET /compute/v2.1/servers/d9d6e198-85f5-488e-8317-d498205f37cc" status: 200 len: 1318 microversion: 2.1 time: 0.308533 Feb 17 04:38:31.697614 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-1ebad78e-d1d0-4229-95d8-206e7ed7edee req-a5d9ebf4-3484-47d5-9204-b862ee194a1d service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:31.698341 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-1ebad78e-d1d0-4229-95d8-206e7ed7edee req-a5d9ebf4-3484-47d5-9204-b862ee194a1d service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:31.698786 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 164/318] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:31 2021] GET /compute/v2.1/servers/d9d6e198-85f5-488e-8317-d498205f37cc => generated 1318 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:31.726389 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.compute.server_external_events [req-1ebad78e-d1d0-4229-95d8-206e7ed7edee req-a5d9ebf4-3484-47d5-9204-b862ee194a1d service nova] Creating event network-vif-plugged:5d940ae4-3a6b-4f9e-94a7-67aabf2dbacb for instance d9d6e198-85f5-488e-8317-d498205f37cc on hv-cinder-76019 Feb 17 04:38:31.732492 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [req-1ebad78e-d1d0-4229-95d8-206e7ed7edee req-a5d9ebf4-3484-47d5-9204-b862ee194a1d service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062943 Feb 17 04:38:31.733708 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 155/319] 10.222.0.38 () {64 vars in 1308 bytes} [Wed Feb 17 04:38:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:38:32.364955 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-c1ada0e2-dcc4-430c-9e0d-3e3967b3d2b9 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:32.365658 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-c1ada0e2-dcc4-430c-9e0d-3e3967b3d2b9 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 68a5c561-c418-4a68-b8b3-1600b638b80c] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:32.378397 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c1ada0e2-dcc4-430c-9e0d-3e3967b3d2b9 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:32.379501 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c1ada0e2-dcc4-430c-9e0d-3e3967b3d2b9 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:32.380392 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c1ada0e2-dcc4-430c-9e0d-3e3967b3d2b9 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:32.382271 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c1ada0e2-dcc4-430c-9e0d-3e3967b3d2b9 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:32.694169 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-c1ada0e2-dcc4-430c-9e0d-3e3967b3d2b9 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:32.711100 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-c1ada0e2-dcc4-430c-9e0d-3e3967b3d2b9 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c" status: 200 len: 1522 microversion: 2.1 time: 0.350094 Feb 17 04:38:32.717201 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-6c690b1d-31cc-497c-ac01-3435e04ad5fc tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:32.717974 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-6c690b1d-31cc-497c-ac01-3435e04ad5fc tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] [instance: d9d6e198-85f5-488e-8317-d498205f37cc] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:32.722466 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 165/320] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:32 2021] GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c => generated 1522 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:32.735262 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6c690b1d-31cc-497c-ac01-3435e04ad5fc tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:32.735770 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6c690b1d-31cc-497c-ac01-3435e04ad5fc tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:32.736643 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6c690b1d-31cc-497c-ac01-3435e04ad5fc tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:32.737143 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6c690b1d-31cc-497c-ac01-3435e04ad5fc tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:33.271050 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-6c690b1d-31cc-497c-ac01-3435e04ad5fc tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a3efaa75e64645abf7555ccfe348d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b23386679f44b7e9d4204ab1e9adf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:33.280752 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-6c690b1d-31cc-497c-ac01-3435e04ad5fc tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] 10.222.0.38 "GET /compute/v2.1/servers/d9d6e198-85f5-488e-8317-d498205f37cc" status: 200 len: 1318 microversion: 2.1 time: 0.568040 Feb 17 04:38:33.281530 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 156/321] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:32 2021] GET /compute/v2.1/servers/d9d6e198-85f5-488e-8317-d498205f37cc => generated 1318 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:33.729868 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-b4604385-30cb-42b0-bf94-89a4520e9ef8 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:33.730741 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-b4604385-30cb-42b0-bf94-89a4520e9ef8 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 68a5c561-c418-4a68-b8b3-1600b638b80c] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:33.744209 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b4604385-30cb-42b0-bf94-89a4520e9ef8 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:33.744899 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b4604385-30cb-42b0-bf94-89a4520e9ef8 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:33.745897 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b4604385-30cb-42b0-bf94-89a4520e9ef8 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:33.746537 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b4604385-30cb-42b0-bf94-89a4520e9ef8 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:33.978586 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-b4604385-30cb-42b0-bf94-89a4520e9ef8 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:33.988639 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-b4604385-30cb-42b0-bf94-89a4520e9ef8 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c" status: 200 len: 1522 microversion: 2.1 time: 0.262549 Feb 17 04:38:33.989431 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 166/322] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:33 2021] GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c => generated 1522 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:34.042558 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-b4f91260-3fcb-4145-8755-c0b8497be1dc tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:34.043171 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-b4f91260-3fcb-4145-8755-c0b8497be1dc tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:34.052215 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b4f91260-3fcb-4145-8755-c0b8497be1dc tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:34.052721 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b4f91260-3fcb-4145-8755-c0b8497be1dc tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:34.053563 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b4f91260-3fcb-4145-8755-c0b8497be1dc tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:34.054055 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b4f91260-3fcb-4145-8755-c0b8497be1dc tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:34.117910 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.objects.instance [None req-b4f91260-3fcb-4145-8755-c0b8497be1dc tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lazy-loading 'flavor' on Instance uuid 8d9c77fb-c4b1-4b48-a00a-b85af63c8920 {{(pid=98081) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:38:34.299289 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-41639b08-875b-4fa1-b349-46107b187f5e tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:34.300188 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-41639b08-875b-4fa1-b349-46107b187f5e tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] [instance: d9d6e198-85f5-488e-8317-d498205f37cc] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:34.326243 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-41639b08-875b-4fa1-b349-46107b187f5e tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:34.327106 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-41639b08-875b-4fa1-b349-46107b187f5e tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:34.328154 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-41639b08-875b-4fa1-b349-46107b187f5e tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:34.328841 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-41639b08-875b-4fa1-b349-46107b187f5e tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:34.591696 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-b4f91260-3fcb-4145-8755-c0b8497be1dc tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "POST /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/action" status: 202 len: 0 microversion: 2.20 time: 0.553075 Feb 17 04:38:34.596388 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 157/323] 10.222.0.38 () {62 vars in 1309 bytes} [Wed Feb 17 04:38:34 2021] POST /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/action => generated 0 bytes in 559 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 17 04:38:34.604480 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-e66c7f3e-2dee-442e-b9fc-f6c262a95880 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ef395a02-48d5-40a1-a56d-662d46faea6b"}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:34.605776 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-e66c7f3e-2dee-442e-b9fc-f6c262a95880 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: 4c526cd8-5f97-4b6f-af6a-ab22442bf0d6] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:34.617949 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e66c7f3e-2dee-442e-b9fc-f6c262a95880 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:34.619444 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e66c7f3e-2dee-442e-b9fc-f6c262a95880 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:34.626664 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e66c7f3e-2dee-442e-b9fc-f6c262a95880 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:34.627362 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e66c7f3e-2dee-442e-b9fc-f6c262a95880 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:34.756426 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-41639b08-875b-4fa1-b349-46107b187f5e tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a3efaa75e64645abf7555ccfe348d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b23386679f44b7e9d4204ab1e9adf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:34.768076 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-41639b08-875b-4fa1-b349-46107b187f5e tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] 10.222.0.38 "GET /compute/v2.1/servers/d9d6e198-85f5-488e-8317-d498205f37cc" status: 200 len: 1506 microversion: 2.1 time: 0.472608 Feb 17 04:38:34.768867 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 167/324] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:34 2021] GET /compute/v2.1/servers/d9d6e198-85f5-488e-8317-d498205f37cc => generated 1506 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:34.780571 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-2bc82a96-487e-4e19-915d-0158e8ddbaeb tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:34.783692 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-2bc82a96-487e-4e19-915d-0158e8ddbaeb tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:34.803518 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2bc82a96-487e-4e19-915d-0158e8ddbaeb tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:34.804141 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2bc82a96-487e-4e19-915d-0158e8ddbaeb tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:34.805508 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2bc82a96-487e-4e19-915d-0158e8ddbaeb tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:34.806019 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2bc82a96-487e-4e19-915d-0158e8ddbaeb tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:34.859510 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.wsgi [None req-e66c7f3e-2dee-442e-b9fc-f6c262a95880 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] HTTP exception thrown: Invalid volume: volume ef395a02-48d5-40a1-a56d-662d46faea6b is already attached to instances: 4c526cd8-5f97-4b6f-af6a-ab22442bf0d6 Feb 17 04:38:34.860192 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-e66c7f3e-2dee-442e-b9fc-f6c262a95880 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Returning 400 to user: Invalid volume: volume ef395a02-48d5-40a1-a56d-662d46faea6b is already attached to instances: 4c526cd8-5f97-4b6f-af6a-ab22442bf0d6 {{(pid=98081) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:38:34.861121 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-e66c7f3e-2dee-442e-b9fc-f6c262a95880 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "POST /compute/v2.1/servers/4c526cd8-5f97-4b6f-af6a-ab22442bf0d6/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.263470 Feb 17 04:38:34.862007 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 158/325] 10.222.0.38 () {60 vars in 1313 bytes} [Wed Feb 17 04:38:34 2021] POST /compute/v2.1/servers/4c526cd8-5f97-4b6f-af6a-ab22442bf0d6/os-volume_attachments => generated 174 bytes in 265 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 17 04:38:34.997158 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-a2a03838-c886-414c-a7e9-633722988954 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:34.998269 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-a2a03838-c886-414c-a7e9-633722988954 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: 4c526cd8-5f97-4b6f-af6a-ab22442bf0d6] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:35.026159 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a2a03838-c886-414c-a7e9-633722988954 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:35.029514 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a2a03838-c886-414c-a7e9-633722988954 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:35.030783 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a2a03838-c886-414c-a7e9-633722988954 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:35.031471 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a2a03838-c886-414c-a7e9-633722988954 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:35.256876 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-2bc82a96-487e-4e19-915d-0158e8ddbaeb tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:35.268361 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-2bc82a96-487e-4e19-915d-0158e8ddbaeb tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:35.270100 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-2bc82a96-487e-4e19-915d-0158e8ddbaeb tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:35.276431 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-2bc82a96-487e-4e19-915d-0158e8ddbaeb tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1725 microversion: 2.20 time: 0.503395 Feb 17 04:38:35.279402 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 168/326] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:38:34 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1725 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:38:35.290614 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-5b7396b4-0cc6-47e4-a2e9-565eb903ef10 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:35.292918 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-5b7396b4-0cc6-47e4-a2e9-565eb903ef10 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 68a5c561-c418-4a68-b8b3-1600b638b80c] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:35.303309 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.objects.instance [None req-a2a03838-c886-414c-a7e9-633722988954 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lazy-loading 'services' on Instance uuid 4c526cd8-5f97-4b6f-af6a-ab22442bf0d6 {{(pid=98081) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:38:35.305709 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5b7396b4-0cc6-47e4-a2e9-565eb903ef10 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:35.306387 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5b7396b4-0cc6-47e4-a2e9-565eb903ef10 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:35.307403 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5b7396b4-0cc6-47e4-a2e9-565eb903ef10 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:35.308038 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5b7396b4-0cc6-47e4-a2e9-565eb903ef10 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:35.488635 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-a2a03838-c886-414c-a7e9-633722988954 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "DELETE /compute/v2.1/servers/4c526cd8-5f97-4b6f-af6a-ab22442bf0d6/os-volume_attachments/ef395a02-48d5-40a1-a56d-662d46faea6b" status: 202 len: 0 microversion: 2.1 time: 0.496867 Feb 17 04:38:35.489406 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 159/327] 10.222.0.38 () {58 vars in 1406 bytes} [Wed Feb 17 04:38:34 2021] DELETE /compute/v2.1/servers/4c526cd8-5f97-4b6f-af6a-ab22442bf0d6/os-volume_attachments/ef395a02-48d5-40a1-a56d-662d46faea6b => generated 0 bytes in 499 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:38:35.698795 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-5b7396b4-0cc6-47e4-a2e9-565eb903ef10 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:35.710416 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-5b7396b4-0cc6-47e4-a2e9-565eb903ef10 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c" status: 200 len: 1522 microversion: 2.1 time: 0.429572 Feb 17 04:38:35.711066 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 169/328] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:35 2021] GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c => generated 1522 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:36.300478 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-4caa7918-9d25-4d3b-b141-07f551291a8d tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:36.302202 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-4caa7918-9d25-4d3b-b141-07f551291a8d tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:36.310925 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4caa7918-9d25-4d3b-b141-07f551291a8d tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:36.311463 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4caa7918-9d25-4d3b-b141-07f551291a8d tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:36.312542 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4caa7918-9d25-4d3b-b141-07f551291a8d tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:36.313044 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4caa7918-9d25-4d3b-b141-07f551291a8d tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:36.728480 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-53bb847c-bb36-464a-9a02-6ab50b0e26cb tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:36.729158 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-53bb847c-bb36-464a-9a02-6ab50b0e26cb tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 68a5c561-c418-4a68-b8b3-1600b638b80c] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:36.739063 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-4caa7918-9d25-4d3b-b141-07f551291a8d tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:36.742235 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-53bb847c-bb36-464a-9a02-6ab50b0e26cb tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:36.742888 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-53bb847c-bb36-464a-9a02-6ab50b0e26cb tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:36.744286 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-53bb847c-bb36-464a-9a02-6ab50b0e26cb tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:36.744925 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-53bb847c-bb36-464a-9a02-6ab50b0e26cb tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:36.748595 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-4caa7918-9d25-4d3b-b141-07f551291a8d tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:36.750164 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-4caa7918-9d25-4d3b-b141-07f551291a8d tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:36.751393 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-4caa7918-9d25-4d3b-b141-07f551291a8d tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1725 microversion: 2.20 time: 0.455491 Feb 17 04:38:36.751990 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 160/329] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:38:36 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1725 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:38:36.990037 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-53bb847c-bb36-464a-9a02-6ab50b0e26cb tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:36.999180 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-53bb847c-bb36-464a-9a02-6ab50b0e26cb tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c" status: 200 len: 1522 microversion: 2.1 time: 0.275164 Feb 17 04:38:37.000153 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 170/330] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:36 2021] GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c => generated 1522 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:37.776495 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-120d3db8-b804-4e1a-8ee8-b477794a7457 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:37.777769 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-120d3db8-b804-4e1a-8ee8-b477794a7457 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:37.818511 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-120d3db8-b804-4e1a-8ee8-b477794a7457 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:37.819436 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-120d3db8-b804-4e1a-8ee8-b477794a7457 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:37.822806 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-120d3db8-b804-4e1a-8ee8-b477794a7457 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:37.823544 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-120d3db8-b804-4e1a-8ee8-b477794a7457 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:37.956488 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-98cc1b68-b7f4-4378-b761-4822484a32b6 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-491547766", "imageRef": "2d6991a7-a1f0-444b-8fd5-d05558b5f9a4", "flavorRef": "452"}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:38.094733 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.network.neutron [None req-98cc1b68-b7f4-4378-b761-4822484a32b6 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] validate_networks() for None {{(pid=98080) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 04:38:38.198286 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-120d3db8-b804-4e1a-8ee8-b477794a7457 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:38.209308 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-120d3db8-b804-4e1a-8ee8-b477794a7457 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:38.210920 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-120d3db8-b804-4e1a-8ee8-b477794a7457 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:38.212107 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-120d3db8-b804-4e1a-8ee8-b477794a7457 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1725 microversion: 2.20 time: 0.443417 Feb 17 04:38:38.212673 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 161/331] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:38:37 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1725 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:38:38.224578 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-661521ed-2d70-43ec-86ea-e191b8d1c28b tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:38.225237 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-661521ed-2d70-43ec-86ea-e191b8d1c28b tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 68a5c561-c418-4a68-b8b3-1600b638b80c] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:38.233486 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-661521ed-2d70-43ec-86ea-e191b8d1c28b tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:38.234033 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-661521ed-2d70-43ec-86ea-e191b8d1c28b tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:38.234900 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-661521ed-2d70-43ec-86ea-e191b8d1c28b tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:38.235392 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-661521ed-2d70-43ec-86ea-e191b8d1c28b tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:38.484356 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-98cc1b68-b7f4-4378-b761-4822484a32b6 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Flavor limits 0:0:0 {{(pid=98080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 04:38:38.485060 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-98cc1b68-b7f4-4378-b761-4822484a32b6 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Image limits 0:0:0 {{(pid=98080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 04:38:38.485815 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-98cc1b68-b7f4-4378-b761-4822484a32b6 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Flavor pref 0:0:0 {{(pid=98080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 04:38:38.486452 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-98cc1b68-b7f4-4378-b761-4822484a32b6 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Image pref 0:0:0 {{(pid=98080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 04:38:38.487050 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-98cc1b68-b7f4-4378-b761-4822484a32b6 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 04:38:38.503468 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-98cc1b68-b7f4-4378-b761-4822484a32b6 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:38.504141 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-98cc1b68-b7f4-4378-b761-4822484a32b6 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:38.505148 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-98cc1b68-b7f4-4378-b761-4822484a32b6 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:38.505755 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-98cc1b68-b7f4-4378-b761-4822484a32b6 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:38.526992 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.quota [None req-98cc1b68-b7f4-4378-b761-4822484a32b6 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Getting quotas for project 326ff5fa6a514a2c88e810faa7b0b6b0. Resources: {'instances', 'cores', 'ram'} {{(pid=98080) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:38:38.532454 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.quota [None req-98cc1b68-b7f4-4378-b761-4822484a32b6 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Getting quotas for user 57dbfaa95e04439c8cef3a3cda68bae2 and project 326ff5fa6a514a2c88e810faa7b0b6b0. Resources: {'instances', 'cores', 'ram'} {{(pid=98080) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:38:38.546231 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-98cc1b68-b7f4-4378-b761-4822484a32b6 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Going to run 1 instances... {{(pid=98080) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 04:38:38.549370 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-98cc1b68-b7f4-4378-b761-4822484a32b6 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] [instance: 63d693d7-4d4a-4013-9ae8-6ab6851111d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d6991a7-a1f0-444b-8fd5-d05558b5f9a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98080) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 04:38:38.558818 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-661521ed-2d70-43ec-86ea-e191b8d1c28b tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:38.568991 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-661521ed-2d70-43ec-86ea-e191b8d1c28b tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c" status: 200 len: 1522 microversion: 2.1 time: 0.354684 Feb 17 04:38:38.579068 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 162/332] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:38 2021] GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c => generated 1522 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:38.586248 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-722599fc-6c7e-4d3b-b95f-ab4049af4416 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1571604501", "imageRef": "2d6991a7-a1f0-444b-8fd5-d05558b5f9a4", "flavorRef": "452", "networks": [{"uuid": "3eac4670-46fd-4c18-9c55-ed035eb365fd"}]}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:38.657781 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.network.neutron [None req-722599fc-6c7e-4d3b-b95f-ab4049af4416 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] validate_networks() for [('3eac4670-46fd-4c18-9c55-ed035eb365fd', None, None, None)] {{(pid=98081) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 04:38:38.667575 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-98cc1b68-b7f4-4378-b761-4822484a32b6 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] 10.222.0.38 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.714892 Feb 17 04:38:38.676989 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 171/333] 10.222.0.38 () {60 vars in 1137 bytes} [Wed Feb 17 04:38:37 2021] POST /compute/v2.1/servers => generated 380 bytes in 725 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 17 04:38:38.682295 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-59962a5e-2a31-4a41-a462-ae8105514e53 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:38.688022 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-59962a5e-2a31-4a41-a462-ae8105514e53 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] [instance: 63d693d7-4d4a-4013-9ae8-6ab6851111d6] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:38.855668 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-59962a5e-2a31-4a41-a462-ae8105514e53 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dbfaa95e04439c8cef3a3cda68bae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326ff5fa6a514a2c88e810faa7b0b6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:38.868750 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-59962a5e-2a31-4a41-a462-ae8105514e53 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] 10.222.0.38 "GET /compute/v2.1/servers/63d693d7-4d4a-4013-9ae8-6ab6851111d6" status: 200 len: 1214 microversion: 2.1 time: 0.190165 Feb 17 04:38:38.869323 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 172/334] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:38 2021] GET /compute/v2.1/servers/63d693d7-4d4a-4013-9ae8-6ab6851111d6 => generated 1214 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:39.231914 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-7b49371d-7880-4a59-8d79-2f7392758e84 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:39.232684 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-7b49371d-7880-4a59-8d79-2f7392758e84 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:39.245427 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7b49371d-7880-4a59-8d79-2f7392758e84 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:39.247401 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7b49371d-7880-4a59-8d79-2f7392758e84 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:39.253223 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7b49371d-7880-4a59-8d79-2f7392758e84 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:39.254551 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7b49371d-7880-4a59-8d79-2f7392758e84 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:39.761900 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-7b49371d-7880-4a59-8d79-2f7392758e84 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:39.775698 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-7b49371d-7880-4a59-8d79-2f7392758e84 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:39.777637 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-7b49371d-7880-4a59-8d79-2f7392758e84 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:39.779198 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-7b49371d-7880-4a59-8d79-2f7392758e84 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1725 microversion: 2.20 time: 0.551320 Feb 17 04:38:39.780024 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 173/335] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:38:39 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1725 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:38:39.786891 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-46114a36-085c-40f5-b4f4-f5e5788ef9fe tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:39.787854 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-46114a36-085c-40f5-b4f4-f5e5788ef9fe tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 68a5c561-c418-4a68-b8b3-1600b638b80c] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:39.795237 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-722599fc-6c7e-4d3b-b95f-ab4049af4416 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Flavor limits 0:0:0 {{(pid=98081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 04:38:39.795636 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-722599fc-6c7e-4d3b-b95f-ab4049af4416 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Image limits 0:0:0 {{(pid=98081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 04:38:39.796183 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-722599fc-6c7e-4d3b-b95f-ab4049af4416 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Flavor pref 0:0:0 {{(pid=98081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 04:38:39.796641 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-722599fc-6c7e-4d3b-b95f-ab4049af4416 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Image pref 0:0:0 {{(pid=98081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 04:38:39.797098 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-722599fc-6c7e-4d3b-b95f-ab4049af4416 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 04:38:39.800049 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-46114a36-085c-40f5-b4f4-f5e5788ef9fe tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:39.801403 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-46114a36-085c-40f5-b4f4-f5e5788ef9fe tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:39.802632 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-46114a36-085c-40f5-b4f4-f5e5788ef9fe tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:39.803628 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-46114a36-085c-40f5-b4f4-f5e5788ef9fe tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:39.807986 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-722599fc-6c7e-4d3b-b95f-ab4049af4416 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:39.808468 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-722599fc-6c7e-4d3b-b95f-ab4049af4416 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:39.810426 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-722599fc-6c7e-4d3b-b95f-ab4049af4416 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:39.811124 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-722599fc-6c7e-4d3b-b95f-ab4049af4416 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:39.834403 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.quota [None req-722599fc-6c7e-4d3b-b95f-ab4049af4416 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Getting quotas for project a6284f2b80524eb0a36ccebaedba767a. Resources: {'instances', 'cores', 'ram'} {{(pid=98081) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:38:39.839375 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.quota [None req-722599fc-6c7e-4d3b-b95f-ab4049af4416 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Getting quotas for user 38a46d18160148f3a48ef4887f6ec7da and project a6284f2b80524eb0a36ccebaedba767a. Resources: {'instances', 'cores', 'ram'} {{(pid=98081) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:38:39.852054 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-722599fc-6c7e-4d3b-b95f-ab4049af4416 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Going to run 1 instances... {{(pid=98081) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 04:38:39.855050 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-722599fc-6c7e-4d3b-b95f-ab4049af4416 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: b5217ba8-1c7d-4811-bc6f-daeedd5d8d02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d6991a7-a1f0-444b-8fd5-d05558b5f9a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98081) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 04:38:39.919332 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-722599fc-6c7e-4d3b-b95f-ab4049af4416 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.337870 Feb 17 04:38:39.920959 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 163/336] 10.222.0.38 () {60 vars in 1137 bytes} [Wed Feb 17 04:38:38 2021] POST /compute/v2.1/servers => generated 380 bytes in 1341 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 17 04:38:39.928446 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-a261e469-facf-49ab-932a-cb050c2ed084 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:39.929433 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-a261e469-facf-49ab-932a-cb050c2ed084 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] [instance: 63d693d7-4d4a-4013-9ae8-6ab6851111d6] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:39.942103 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a261e469-facf-49ab-932a-cb050c2ed084 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:39.943015 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a261e469-facf-49ab-932a-cb050c2ed084 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:39.943893 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a261e469-facf-49ab-932a-cb050c2ed084 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:39.944393 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a261e469-facf-49ab-932a-cb050c2ed084 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:40.177437 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-46114a36-085c-40f5-b4f4-f5e5788ef9fe tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:40.183442 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-a261e469-facf-49ab-932a-cb050c2ed084 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dbfaa95e04439c8cef3a3cda68bae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326ff5fa6a514a2c88e810faa7b0b6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:40.195122 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-a261e469-facf-49ab-932a-cb050c2ed084 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] 10.222.0.38 "GET /compute/v2.1/servers/63d693d7-4d4a-4013-9ae8-6ab6851111d6" status: 200 len: 1266 microversion: 2.1 time: 0.272654 Feb 17 04:38:40.196240 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-46114a36-085c-40f5-b4f4-f5e5788ef9fe tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c" status: 200 len: 1522 microversion: 2.1 time: 0.414469 Feb 17 04:38:40.202039 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 174/337] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:39 2021] GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c => generated 1522 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:40.207162 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 164/338] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:39 2021] GET /compute/v2.1/servers/63d693d7-4d4a-4013-9ae8-6ab6851111d6 => generated 1266 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:40.208796 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-0a8f7a1a-73e3-46eb-a1c7-9c299092734c tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:40.209482 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-0a8f7a1a-73e3-46eb-a1c7-9c299092734c tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: b5217ba8-1c7d-4811-bc6f-daeedd5d8d02] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:40.337188 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-0a8f7a1a-73e3-46eb-a1c7-9c299092734c tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a46d18160148f3a48ef4887f6ec7da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6284f2b80524eb0a36ccebaedba767a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:40.349306 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-0a8f7a1a-73e3-46eb-a1c7-9c299092734c tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "GET /compute/v2.1/servers/b5217ba8-1c7d-4811-bc6f-daeedd5d8d02" status: 200 len: 1218 microversion: 2.1 time: 0.145850 Feb 17 04:38:40.360064 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 175/339] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:40 2021] GET /compute/v2.1/servers/b5217ba8-1c7d-4811-bc6f-daeedd5d8d02 => generated 1218 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:40.802210 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-59f26ce6-e32c-41e7-b1a4-9007b1031671 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:40.803131 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-59f26ce6-e32c-41e7-b1a4-9007b1031671 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:40.824633 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-59f26ce6-e32c-41e7-b1a4-9007b1031671 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:40.825139 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-59f26ce6-e32c-41e7-b1a4-9007b1031671 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:40.825992 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-59f26ce6-e32c-41e7-b1a4-9007b1031671 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:40.826480 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-59f26ce6-e32c-41e7-b1a4-9007b1031671 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:41.218137 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-3b5f338f-4389-4f37-9117-a4565fdf84b2 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:41.219238 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-3b5f338f-4389-4f37-9117-a4565fdf84b2 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] [instance: 63d693d7-4d4a-4013-9ae8-6ab6851111d6] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:41.228972 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-3b5f338f-4389-4f37-9117-a4565fdf84b2 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:41.229574 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-3b5f338f-4389-4f37-9117-a4565fdf84b2 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:41.230755 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-3b5f338f-4389-4f37-9117-a4565fdf84b2 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:41.231383 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-3b5f338f-4389-4f37-9117-a4565fdf84b2 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:41.405209 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-3b5f338f-4389-4f37-9117-a4565fdf84b2 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dbfaa95e04439c8cef3a3cda68bae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326ff5fa6a514a2c88e810faa7b0b6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:41.437126 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-3b5f338f-4389-4f37-9117-a4565fdf84b2 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] 10.222.0.38 "GET /compute/v2.1/servers/63d693d7-4d4a-4013-9ae8-6ab6851111d6" status: 200 len: 1272 microversion: 2.1 time: 0.215631 Feb 17 04:38:41.438408 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 176/340] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:41 2021] GET /compute/v2.1/servers/63d693d7-4d4a-4013-9ae8-6ab6851111d6 => generated 1272 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:38:41.459719 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-6b514992-4dd8-47fe-a7eb-38bac0a8b029 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:41.460820 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-6b514992-4dd8-47fe-a7eb-38bac0a8b029 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 68a5c561-c418-4a68-b8b3-1600b638b80c] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:41.463928 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-59f26ce6-e32c-41e7-b1a4-9007b1031671 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:41.481339 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-59f26ce6-e32c-41e7-b1a4-9007b1031671 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:41.484319 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-59f26ce6-e32c-41e7-b1a4-9007b1031671 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:41.491345 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6b514992-4dd8-47fe-a7eb-38bac0a8b029 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:41.492173 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6b514992-4dd8-47fe-a7eb-38bac0a8b029 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:41.493209 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6b514992-4dd8-47fe-a7eb-38bac0a8b029 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:41.493857 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6b514992-4dd8-47fe-a7eb-38bac0a8b029 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:41.496370 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-59f26ce6-e32c-41e7-b1a4-9007b1031671 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1725 microversion: 2.20 time: 0.699554 Feb 17 04:38:41.510624 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 165/341] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:38:40 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1725 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:38:41.510624 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-6d0e03d9-fab2-45c1-a5a4-0acc6e49d080 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:41.510624 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-6d0e03d9-fab2-45c1-a5a4-0acc6e49d080 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: b5217ba8-1c7d-4811-bc6f-daeedd5d8d02] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:41.563522 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6d0e03d9-fab2-45c1-a5a4-0acc6e49d080 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:41.567234 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6d0e03d9-fab2-45c1-a5a4-0acc6e49d080 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:41.570625 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6d0e03d9-fab2-45c1-a5a4-0acc6e49d080 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:41.574042 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6d0e03d9-fab2-45c1-a5a4-0acc6e49d080 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:42.213242 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-6d0e03d9-fab2-45c1-a5a4-0acc6e49d080 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a46d18160148f3a48ef4887f6ec7da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6284f2b80524eb0a36ccebaedba767a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:42.227128 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-6d0e03d9-fab2-45c1-a5a4-0acc6e49d080 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "GET /compute/v2.1/servers/b5217ba8-1c7d-4811-bc6f-daeedd5d8d02" status: 200 len: 1278 microversion: 2.1 time: 0.726127 Feb 17 04:38:42.228304 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 166/342] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:41 2021] GET /compute/v2.1/servers/b5217ba8-1c7d-4811-bc6f-daeedd5d8d02 => generated 1278 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:42.457607 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-e59169d7-58ab-42a6-ae0b-b5c1c30184fb tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:42.460296 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-e59169d7-58ab-42a6-ae0b-b5c1c30184fb tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] [instance: 63d693d7-4d4a-4013-9ae8-6ab6851111d6] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:42.471292 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e59169d7-58ab-42a6-ae0b-b5c1c30184fb tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:42.472128 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e59169d7-58ab-42a6-ae0b-b5c1c30184fb tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:42.474205 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e59169d7-58ab-42a6-ae0b-b5c1c30184fb tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:42.474924 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e59169d7-58ab-42a6-ae0b-b5c1c30184fb tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:42.822647 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-e59169d7-58ab-42a6-ae0b-b5c1c30184fb tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dbfaa95e04439c8cef3a3cda68bae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326ff5fa6a514a2c88e810faa7b0b6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:42.824695 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-6b514992-4dd8-47fe-a7eb-38bac0a8b029 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:42.836926 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-e59169d7-58ab-42a6-ae0b-b5c1c30184fb tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] 10.222.0.38 "GET /compute/v2.1/servers/63d693d7-4d4a-4013-9ae8-6ab6851111d6" status: 200 len: 1272 microversion: 2.1 time: 0.384839 Feb 17 04:38:42.837549 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 167/343] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:42 2021] GET /compute/v2.1/servers/63d693d7-4d4a-4013-9ae8-6ab6851111d6 => generated 1272 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:42.839836 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-6b514992-4dd8-47fe-a7eb-38bac0a8b029 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c" status: 200 len: 1522 microversion: 2.1 time: 1.400869 Feb 17 04:38:42.847600 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 177/344] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:41 2021] GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c => generated 1522 bytes in 1409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:42.861030 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-520f4608-2f36-45a1-b9ce-ff05d5543e5a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:42.862110 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-520f4608-2f36-45a1-b9ce-ff05d5543e5a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:42.870646 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-520f4608-2f36-45a1-b9ce-ff05d5543e5a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:42.871154 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-520f4608-2f36-45a1-b9ce-ff05d5543e5a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:42.872728 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-520f4608-2f36-45a1-b9ce-ff05d5543e5a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:42.873222 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-520f4608-2f36-45a1-b9ce-ff05d5543e5a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:43.248175 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-88bf99e8-1d76-48d1-9a11-bfd7c852e9b2 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:43.254467 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-88bf99e8-1d76-48d1-9a11-bfd7c852e9b2 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: b5217ba8-1c7d-4811-bc6f-daeedd5d8d02] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:43.285722 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-88bf99e8-1d76-48d1-9a11-bfd7c852e9b2 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:43.286842 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-88bf99e8-1d76-48d1-9a11-bfd7c852e9b2 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:43.290898 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-88bf99e8-1d76-48d1-9a11-bfd7c852e9b2 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:43.291722 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-88bf99e8-1d76-48d1-9a11-bfd7c852e9b2 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:43.966496 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-88bf99e8-1d76-48d1-9a11-bfd7c852e9b2 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a46d18160148f3a48ef4887f6ec7da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6284f2b80524eb0a36ccebaedba767a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:43.979623 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-88bf99e8-1d76-48d1-9a11-bfd7c852e9b2 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "GET /compute/v2.1/servers/b5217ba8-1c7d-4811-bc6f-daeedd5d8d02" status: 200 len: 1276 microversion: 2.1 time: 0.737608 Feb 17 04:38:43.980477 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 178/345] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:43 2021] GET /compute/v2.1/servers/b5217ba8-1c7d-4811-bc6f-daeedd5d8d02 => generated 1276 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:38:43.988639 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-bbc7fda7-c07e-4821-94f2-2f854c576b9f tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:43.989519 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-bbc7fda7-c07e-4821-94f2-2f854c576b9f tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] [instance: 63d693d7-4d4a-4013-9ae8-6ab6851111d6] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:43.999212 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-bbc7fda7-c07e-4821-94f2-2f854c576b9f tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:43.999930 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-bbc7fda7-c07e-4821-94f2-2f854c576b9f tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:44.000943 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-bbc7fda7-c07e-4821-94f2-2f854c576b9f tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:44.001615 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-bbc7fda7-c07e-4821-94f2-2f854c576b9f tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:44.290532 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-bbc7fda7-c07e-4821-94f2-2f854c576b9f tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dbfaa95e04439c8cef3a3cda68bae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326ff5fa6a514a2c88e810faa7b0b6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:44.301522 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-bbc7fda7-c07e-4821-94f2-2f854c576b9f tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] 10.222.0.38 "GET /compute/v2.1/servers/63d693d7-4d4a-4013-9ae8-6ab6851111d6" status: 200 len: 1272 microversion: 2.1 time: 0.316261 Feb 17 04:38:44.311515 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 179/346] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:43 2021] GET /compute/v2.1/servers/63d693d7-4d4a-4013-9ae8-6ab6851111d6 => generated 1272 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:44.311515 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-c2014deb-713a-443b-84e5-3c0715191295 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:44.311515 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-c2014deb-713a-443b-84e5-3c0715191295 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 68a5c561-c418-4a68-b8b3-1600b638b80c] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:44.319861 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c2014deb-713a-443b-84e5-3c0715191295 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:44.320080 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c2014deb-713a-443b-84e5-3c0715191295 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:44.321036 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c2014deb-713a-443b-84e5-3c0715191295 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:44.321814 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c2014deb-713a-443b-84e5-3c0715191295 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:44.768107 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-520f4608-2f36-45a1-b9ce-ff05d5543e5a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:44.788543 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-520f4608-2f36-45a1-b9ce-ff05d5543e5a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:44.790133 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-520f4608-2f36-45a1-b9ce-ff05d5543e5a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:44.791383 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-520f4608-2f36-45a1-b9ce-ff05d5543e5a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1725 microversion: 2.20 time: 1.937129 Feb 17 04:38:44.791962 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 168/347] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:38:42 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1725 bytes in 1954 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:38:44.997437 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-e8c818b4-e4a8-4342-85ea-5f9c16ad5aab tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:44.998144 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-e8c818b4-e4a8-4342-85ea-5f9c16ad5aab tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: b5217ba8-1c7d-4811-bc6f-daeedd5d8d02] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:45.023059 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e8c818b4-e4a8-4342-85ea-5f9c16ad5aab tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:45.034305 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e8c818b4-e4a8-4342-85ea-5f9c16ad5aab tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:45.036395 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e8c818b4-e4a8-4342-85ea-5f9c16ad5aab tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:45.036921 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e8c818b4-e4a8-4342-85ea-5f9c16ad5aab tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:45.289990 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-e8c818b4-e4a8-4342-85ea-5f9c16ad5aab tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a46d18160148f3a48ef4887f6ec7da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6284f2b80524eb0a36ccebaedba767a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:45.303237 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-e8c818b4-e4a8-4342-85ea-5f9c16ad5aab tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "GET /compute/v2.1/servers/b5217ba8-1c7d-4811-bc6f-daeedd5d8d02" status: 200 len: 1276 microversion: 2.1 time: 0.309539 Feb 17 04:38:45.304413 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 169/348] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:44 2021] GET /compute/v2.1/servers/b5217ba8-1c7d-4811-bc6f-daeedd5d8d02 => generated 1276 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:45.320618 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-061bd49a-89bb-4253-a5e4-1c1385e8f954 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:45.321294 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-061bd49a-89bb-4253-a5e4-1c1385e8f954 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] [instance: 63d693d7-4d4a-4013-9ae8-6ab6851111d6] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:45.329229 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-061bd49a-89bb-4253-a5e4-1c1385e8f954 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:45.329804 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-061bd49a-89bb-4253-a5e4-1c1385e8f954 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:45.330643 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-061bd49a-89bb-4253-a5e4-1c1385e8f954 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:45.331058 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-061bd49a-89bb-4253-a5e4-1c1385e8f954 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:45.764652 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-c2014deb-713a-443b-84e5-3c0715191295 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:45.782197 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-c2014deb-713a-443b-84e5-3c0715191295 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c" status: 200 len: 1522 microversion: 2.1 time: 1.477966 Feb 17 04:38:45.782876 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 180/349] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:44 2021] GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c => generated 1522 bytes in 1480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:45.835616 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-a42aec66-19dd-4cdb-8579-d098df1cf689 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:45.836297 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-a42aec66-19dd-4cdb-8579-d098df1cf689 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:45.856935 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a42aec66-19dd-4cdb-8579-d098df1cf689 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:45.857262 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a42aec66-19dd-4cdb-8579-d098df1cf689 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:45.858764 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a42aec66-19dd-4cdb-8579-d098df1cf689 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:45.862697 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a42aec66-19dd-4cdb-8579-d098df1cf689 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:46.850275 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-061bd49a-89bb-4253-a5e4-1c1385e8f954 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dbfaa95e04439c8cef3a3cda68bae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326ff5fa6a514a2c88e810faa7b0b6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:46.861808 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-061bd49a-89bb-4253-a5e4-1c1385e8f954 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] 10.222.0.38 "GET /compute/v2.1/servers/63d693d7-4d4a-4013-9ae8-6ab6851111d6" status: 200 len: 1314 microversion: 2.1 time: 1.545208 Feb 17 04:38:46.875458 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 170/350] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:45 2021] GET /compute/v2.1/servers/63d693d7-4d4a-4013-9ae8-6ab6851111d6 => generated 1314 bytes in 1560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:46.888376 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-025f2ba2-e489-4128-9837-5e45370c0412 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:46.889415 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-025f2ba2-e489-4128-9837-5e45370c0412 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: b5217ba8-1c7d-4811-bc6f-daeedd5d8d02] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:46.903609 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-025f2ba2-e489-4128-9837-5e45370c0412 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:46.904319 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-025f2ba2-e489-4128-9837-5e45370c0412 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:46.906557 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-025f2ba2-e489-4128-9837-5e45370c0412 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:46.909307 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-025f2ba2-e489-4128-9837-5e45370c0412 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:46.943990 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-a42aec66-19dd-4cdb-8579-d098df1cf689 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:46.957087 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-a42aec66-19dd-4cdb-8579-d098df1cf689 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:46.964578 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-a42aec66-19dd-4cdb-8579-d098df1cf689 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:46.965834 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-a42aec66-19dd-4cdb-8579-d098df1cf689 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1725 microversion: 2.20 time: 1.135547 Feb 17 04:38:46.983202 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 181/351] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:38:45 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1725 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:38:46.989275 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-91b5cdd2-7586-42fe-9c81-d01fc0a247ce tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:46.995406 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-91b5cdd2-7586-42fe-9c81-d01fc0a247ce tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 68a5c561-c418-4a68-b8b3-1600b638b80c] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:47.010779 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-91b5cdd2-7586-42fe-9c81-d01fc0a247ce tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:47.019729 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-91b5cdd2-7586-42fe-9c81-d01fc0a247ce tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:47.020964 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-91b5cdd2-7586-42fe-9c81-d01fc0a247ce tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:47.021839 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-91b5cdd2-7586-42fe-9c81-d01fc0a247ce tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:48.051754 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-91b5cdd2-7586-42fe-9c81-d01fc0a247ce tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:48.061900 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-91b5cdd2-7586-42fe-9c81-d01fc0a247ce tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c" status: 200 len: 1502 microversion: 2.1 time: 1.077108 Feb 17 04:38:48.062619 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 182/352] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:46 2021] GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c => generated 1502 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:48.067433 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-707c2c26-a439-4433-8155-af62dd97c103 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:48.068106 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-707c2c26-a439-4433-8155-af62dd97c103 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] [instance: 63d693d7-4d4a-4013-9ae8-6ab6851111d6] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:48.075881 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-707c2c26-a439-4433-8155-af62dd97c103 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:48.076469 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-707c2c26-a439-4433-8155-af62dd97c103 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:48.077827 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-707c2c26-a439-4433-8155-af62dd97c103 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:48.078334 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-707c2c26-a439-4433-8155-af62dd97c103 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:48.177458 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-025f2ba2-e489-4128-9837-5e45370c0412 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a46d18160148f3a48ef4887f6ec7da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6284f2b80524eb0a36ccebaedba767a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:48.187446 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-025f2ba2-e489-4128-9837-5e45370c0412 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "GET /compute/v2.1/servers/b5217ba8-1c7d-4811-bc6f-daeedd5d8d02" status: 200 len: 1318 microversion: 2.1 time: 1.310460 Feb 17 04:38:48.188043 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 171/353] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:46 2021] GET /compute/v2.1/servers/b5217ba8-1c7d-4811-bc6f-daeedd5d8d02 => generated 1318 bytes in 1312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:48.200746 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-34fb6808-9871-4fc3-9fc5-1c4ad840371b tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:48.201462 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-34fb6808-9871-4fc3-9fc5-1c4ad840371b tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:48.210400 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-34fb6808-9871-4fc3-9fc5-1c4ad840371b tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:48.210951 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-34fb6808-9871-4fc3-9fc5-1c4ad840371b tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:48.211802 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-34fb6808-9871-4fc3-9fc5-1c4ad840371b tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:48.212303 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-34fb6808-9871-4fc3-9fc5-1c4ad840371b tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:49.558622 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-34fb6808-9871-4fc3-9fc5-1c4ad840371b tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:49.569096 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-34fb6808-9871-4fc3-9fc5-1c4ad840371b tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:49.570985 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-34fb6808-9871-4fc3-9fc5-1c4ad840371b tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:49.572249 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-34fb6808-9871-4fc3-9fc5-1c4ad840371b tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1725 microversion: 2.20 time: 1.383218 Feb 17 04:38:49.572893 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 172/354] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:38:48 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1725 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:38:49.577951 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-65f997f6-2558-4c1b-bd11-d0dd739dcd88 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0132ae1b-cbd0-4901-9e53-b6751cd8f655"}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:49.579267 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-65f997f6-2558-4c1b-bd11-d0dd739dcd88 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 68a5c561-c418-4a68-b8b3-1600b638b80c] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:49.587608 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-65f997f6-2558-4c1b-bd11-d0dd739dcd88 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:49.588118 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-65f997f6-2558-4c1b-bd11-d0dd739dcd88 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:49.588951 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-65f997f6-2558-4c1b-bd11-d0dd739dcd88 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:49.589447 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-65f997f6-2558-4c1b-bd11-d0dd739dcd88 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:49.658524 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.wsgi [None req-65f997f6-2558-4c1b-bd11-d0dd739dcd88 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] HTTP exception thrown: Cannot 'attach_volume' instance 68a5c561-c418-4a68-b8b3-1600b638b80c while it is in vm_state rescued Feb 17 04:38:49.659262 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-65f997f6-2558-4c1b-bd11-d0dd739dcd88 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Returning 409 to user: Cannot 'attach_volume' instance 68a5c561-c418-4a68-b8b3-1600b638b80c while it is in vm_state rescued {{(pid=98081) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:38:49.660783 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-65f997f6-2558-4c1b-bd11-d0dd739dcd88 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "POST /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.086735 Feb 17 04:38:49.661397 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 173/355] 10.222.0.38 () {60 vars in 1313 bytes} [Wed Feb 17 04:38:49 2021] POST /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c/os-volume_attachments => generated 152 bytes in 88 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Feb 17 04:38:49.665996 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-9a0a368e-ea8c-4fca-b517-b18bed9dea59 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:49.666674 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-9a0a368e-ea8c-4fca-b517-b18bed9dea59 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: b5217ba8-1c7d-4811-bc6f-daeedd5d8d02] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:49.674407 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9a0a368e-ea8c-4fca-b517-b18bed9dea59 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:49.674991 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9a0a368e-ea8c-4fca-b517-b18bed9dea59 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:49.676172 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9a0a368e-ea8c-4fca-b517-b18bed9dea59 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:49.676669 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9a0a368e-ea8c-4fca-b517-b18bed9dea59 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:49.729363 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-707c2c26-a439-4433-8155-af62dd97c103 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dbfaa95e04439c8cef3a3cda68bae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326ff5fa6a514a2c88e810faa7b0b6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:49.747215 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-707c2c26-a439-4433-8155-af62dd97c103 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] 10.222.0.38 "GET /compute/v2.1/servers/63d693d7-4d4a-4013-9ae8-6ab6851111d6" status: 200 len: 1314 microversion: 2.1 time: 1.683349 Feb 17 04:38:49.748955 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 183/356] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:48 2021] GET /compute/v2.1/servers/63d693d7-4d4a-4013-9ae8-6ab6851111d6 => generated 1314 bytes in 1686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:49.767336 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-4dc0cf8b-4138-4d1a-8398-7b1cffa89aee tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:49.767686 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-4dc0cf8b-4138-4d1a-8398-7b1cffa89aee tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 68a5c561-c418-4a68-b8b3-1600b638b80c] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:49.777544 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4dc0cf8b-4138-4d1a-8398-7b1cffa89aee tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:49.778054 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4dc0cf8b-4138-4d1a-8398-7b1cffa89aee tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:49.778931 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4dc0cf8b-4138-4d1a-8398-7b1cffa89aee tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:49.779414 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4dc0cf8b-4138-4d1a-8398-7b1cffa89aee tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:49.932223 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-4dc0cf8b-4138-4d1a-8398-7b1cffa89aee tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "POST /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c/action" status: 202 len: 0 microversion: 2.1 time: 0.170894 Feb 17 04:38:49.934584 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 184/357] 10.222.0.38 () {60 vars in 1268 bytes} [Wed Feb 17 04:38:49 2021] POST /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:38:49.945415 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-ed2abe1a-200c-4449-909e-50fc2c0a5010 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:49.946436 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-ed2abe1a-200c-4449-909e-50fc2c0a5010 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 68a5c561-c418-4a68-b8b3-1600b638b80c] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:49.978643 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ed2abe1a-200c-4449-909e-50fc2c0a5010 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:49.979309 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ed2abe1a-200c-4449-909e-50fc2c0a5010 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:49.980182 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ed2abe1a-200c-4449-909e-50fc2c0a5010 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:49.980680 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ed2abe1a-200c-4449-909e-50fc2c0a5010 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:50.923179 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-9a0a368e-ea8c-4fca-b517-b18bed9dea59 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a46d18160148f3a48ef4887f6ec7da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6284f2b80524eb0a36ccebaedba767a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:50.933218 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-9a0a368e-ea8c-4fca-b517-b18bed9dea59 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "GET /compute/v2.1/servers/b5217ba8-1c7d-4811-bc6f-daeedd5d8d02" status: 200 len: 1318 microversion: 2.1 time: 1.270673 Feb 17 04:38:50.934141 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 174/358] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:49 2021] GET /compute/v2.1/servers/b5217ba8-1c7d-4811-bc6f-daeedd5d8d02 => generated 1318 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:50.953290 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-fd1a8188-2253-4961-8fbe-f0006ed79fc9 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:50.964252 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-fd1a8188-2253-4961-8fbe-f0006ed79fc9 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:50.976013 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-fd1a8188-2253-4961-8fbe-f0006ed79fc9 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:50.976785 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-fd1a8188-2253-4961-8fbe-f0006ed79fc9 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:50.977807 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-fd1a8188-2253-4961-8fbe-f0006ed79fc9 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:50.978456 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-fd1a8188-2253-4961-8fbe-f0006ed79fc9 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:51.533605 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-ed2abe1a-200c-4449-909e-50fc2c0a5010 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:51.544892 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-ed2abe1a-200c-4449-909e-50fc2c0a5010 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c" status: 200 len: 1510 microversion: 2.1 time: 1.606411 Feb 17 04:38:51.545512 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 185/359] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:49 2021] GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c => generated 1510 bytes in 1608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:51.551266 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-b36bc7fa-6981-4089-a448-41301f45b272 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:51.552173 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-b36bc7fa-6981-4089-a448-41301f45b272 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] [instance: 63d693d7-4d4a-4013-9ae8-6ab6851111d6] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:51.560243 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b36bc7fa-6981-4089-a448-41301f45b272 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:51.560737 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b36bc7fa-6981-4089-a448-41301f45b272 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:51.561974 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b36bc7fa-6981-4089-a448-41301f45b272 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:51.562847 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b36bc7fa-6981-4089-a448-41301f45b272 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:52.185637 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-fd1a8188-2253-4961-8fbe-f0006ed79fc9 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:52.198266 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-fd1a8188-2253-4961-8fbe-f0006ed79fc9 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:52.200483 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-fd1a8188-2253-4961-8fbe-f0006ed79fc9 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:52.201721 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-fd1a8188-2253-4961-8fbe-f0006ed79fc9 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1725 microversion: 2.20 time: 1.265933 Feb 17 04:38:52.202271 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 175/360] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:38:50 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1725 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:38:52.212118 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-10157969-cc73-45c1-bd9b-78a541e6aac4 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:52.213028 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-10157969-cc73-45c1-bd9b-78a541e6aac4 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: b5217ba8-1c7d-4811-bc6f-daeedd5d8d02] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:52.223368 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-10157969-cc73-45c1-bd9b-78a541e6aac4 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:52.223802 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-10157969-cc73-45c1-bd9b-78a541e6aac4 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:52.224670 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-10157969-cc73-45c1-bd9b-78a541e6aac4 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:52.225178 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-10157969-cc73-45c1-bd9b-78a541e6aac4 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:52.990485 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-b36bc7fa-6981-4089-a448-41301f45b272 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dbfaa95e04439c8cef3a3cda68bae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326ff5fa6a514a2c88e810faa7b0b6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:53.001293 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-b36bc7fa-6981-4089-a448-41301f45b272 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] 10.222.0.38 "GET /compute/v2.1/servers/63d693d7-4d4a-4013-9ae8-6ab6851111d6" status: 200 len: 1314 microversion: 2.1 time: 1.454547 Feb 17 04:38:53.002398 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 186/361] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:51 2021] GET /compute/v2.1/servers/63d693d7-4d4a-4013-9ae8-6ab6851111d6 => generated 1314 bytes in 1456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:53.008835 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [req-d2f9787d-1ae9-4c2e-8809-7c038932f5e4 req-9129911a-621f-4476-b6a3-a337440c6096 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63d693d7-4d4a-4013-9ae8-6ab6851111d6", "tag": "e12100f6-dd98-4a5d-b88d-cfacc2029e5d"}]} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:53.011353 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:38:53.011353 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:38:53.025754 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-d2f9787d-1ae9-4c2e-8809-7c038932f5e4 req-9129911a-621f-4476-b6a3-a337440c6096 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:53.027014 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-d2f9787d-1ae9-4c2e-8809-7c038932f5e4 req-9129911a-621f-4476-b6a3-a337440c6096 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:53.048369 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.compute.server_external_events [req-d2f9787d-1ae9-4c2e-8809-7c038932f5e4 req-9129911a-621f-4476-b6a3-a337440c6096 service nova] Creating event network-changed:e12100f6-dd98-4a5d-b88d-cfacc2029e5d for instance 63d693d7-4d4a-4013-9ae8-6ab6851111d6 on hv-cinder-76019 Feb 17 04:38:53.053511 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [req-d2f9787d-1ae9-4c2e-8809-7c038932f5e4 req-9129911a-621f-4476-b6a3-a337440c6096 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048914 Feb 17 04:38:53.054282 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 187/362] 10.222.0.38 () {64 vars in 1308 bytes} [Wed Feb 17 04:38:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:38:53.060520 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-a142a0d4-6333-49a6-acb2-36e5d7309c3b tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:53.061458 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-a142a0d4-6333-49a6-acb2-36e5d7309c3b tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 68a5c561-c418-4a68-b8b3-1600b638b80c] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:53.071182 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a142a0d4-6333-49a6-acb2-36e5d7309c3b tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:53.072159 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a142a0d4-6333-49a6-acb2-36e5d7309c3b tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:53.073616 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a142a0d4-6333-49a6-acb2-36e5d7309c3b tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:53.074262 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a142a0d4-6333-49a6-acb2-36e5d7309c3b tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:53.499730 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-10157969-cc73-45c1-bd9b-78a541e6aac4 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a46d18160148f3a48ef4887f6ec7da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6284f2b80524eb0a36ccebaedba767a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:53.509542 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-10157969-cc73-45c1-bd9b-78a541e6aac4 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "GET /compute/v2.1/servers/b5217ba8-1c7d-4811-bc6f-daeedd5d8d02" status: 200 len: 1318 microversion: 2.1 time: 1.305980 Feb 17 04:38:53.510245 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 176/363] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:52 2021] GET /compute/v2.1/servers/b5217ba8-1c7d-4811-bc6f-daeedd5d8d02 => generated 1318 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:53.515051 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-1c6ce2aa-ade6-408d-bbad-1dfc5d726aae tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:53.515735 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-1c6ce2aa-ade6-408d-bbad-1dfc5d726aae tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:53.523461 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1c6ce2aa-ade6-408d-bbad-1dfc5d726aae tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:53.524055 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1c6ce2aa-ade6-408d-bbad-1dfc5d726aae tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:53.524930 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1c6ce2aa-ade6-408d-bbad-1dfc5d726aae tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:53.525423 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1c6ce2aa-ade6-408d-bbad-1dfc5d726aae tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:53.932050 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-a142a0d4-6333-49a6-acb2-36e5d7309c3b tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:53.946271 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-a142a0d4-6333-49a6-acb2-36e5d7309c3b tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c" status: 200 len: 1510 microversion: 2.1 time: 0.890391 Feb 17 04:38:53.948732 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 188/364] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:53 2021] GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c => generated 1510 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:54.021305 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-01f2ab8e-dd5e-4e37-8004-22b7511e981e tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:54.022185 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-01f2ab8e-dd5e-4e37-8004-22b7511e981e tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] [instance: 63d693d7-4d4a-4013-9ae8-6ab6851111d6] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:54.037186 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-01f2ab8e-dd5e-4e37-8004-22b7511e981e tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:54.039854 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-01f2ab8e-dd5e-4e37-8004-22b7511e981e tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:54.040936 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-01f2ab8e-dd5e-4e37-8004-22b7511e981e tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:54.041776 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-01f2ab8e-dd5e-4e37-8004-22b7511e981e tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:54.275852 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-1c6ce2aa-ade6-408d-bbad-1dfc5d726aae tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:54.296010 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-1c6ce2aa-ade6-408d-bbad-1dfc5d726aae tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:54.297496 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-1c6ce2aa-ade6-408d-bbad-1dfc5d726aae tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:54.298720 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-1c6ce2aa-ade6-408d-bbad-1dfc5d726aae tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1725 microversion: 2.20 time: 0.787335 Feb 17 04:38:54.299318 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 177/365] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:38:53 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1725 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:38:54.527646 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-d85fc7b5-7137-4397-b928-912adf01d2e3 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:54.528284 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-d85fc7b5-7137-4397-b928-912adf01d2e3 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: b5217ba8-1c7d-4811-bc6f-daeedd5d8d02] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:54.540658 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d85fc7b5-7137-4397-b928-912adf01d2e3 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:54.547822 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d85fc7b5-7137-4397-b928-912adf01d2e3 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:54.552095 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d85fc7b5-7137-4397-b928-912adf01d2e3 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:54.552981 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d85fc7b5-7137-4397-b928-912adf01d2e3 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:55.104443 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-01f2ab8e-dd5e-4e37-8004-22b7511e981e tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dbfaa95e04439c8cef3a3cda68bae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326ff5fa6a514a2c88e810faa7b0b6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:55.119479 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-01f2ab8e-dd5e-4e37-8004-22b7511e981e tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] 10.222.0.38 "GET /compute/v2.1/servers/63d693d7-4d4a-4013-9ae8-6ab6851111d6" status: 200 len: 1314 microversion: 2.1 time: 1.103480 Feb 17 04:38:55.122963 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 189/366] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:54 2021] GET /compute/v2.1/servers/63d693d7-4d4a-4013-9ae8-6ab6851111d6 => generated 1314 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:38:55.134548 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-33a53c40-de46-478d-b763-5e944398e8ad tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:55.138998 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-33a53c40-de46-478d-b763-5e944398e8ad tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 68a5c561-c418-4a68-b8b3-1600b638b80c] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:55.156945 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-33a53c40-de46-478d-b763-5e944398e8ad tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:55.158449 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-33a53c40-de46-478d-b763-5e944398e8ad tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:55.162226 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-33a53c40-de46-478d-b763-5e944398e8ad tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:55.162941 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-33a53c40-de46-478d-b763-5e944398e8ad tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:55.307784 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-d85fc7b5-7137-4397-b928-912adf01d2e3 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a46d18160148f3a48ef4887f6ec7da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6284f2b80524eb0a36ccebaedba767a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:55.320918 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-d85fc7b5-7137-4397-b928-912adf01d2e3 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "GET /compute/v2.1/servers/b5217ba8-1c7d-4811-bc6f-daeedd5d8d02" status: 200 len: 1318 microversion: 2.1 time: 0.797062 Feb 17 04:38:55.321512 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 178/367] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:54 2021] GET /compute/v2.1/servers/b5217ba8-1c7d-4811-bc6f-daeedd5d8d02 => generated 1318 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:55.336199 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [req-2f2e35ec-b06f-415b-8263-2b57fb8edb39 req-77d80e35-4fa5-439a-9620-60e564872bdd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5217ba8-1c7d-4811-bc6f-daeedd5d8d02", "tag": "9a1fe4fe-80c8-4bb9-aef0-db5351e50d39"}]} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:55.345069 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:38:55.345069 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:38:55.365829 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-2f2e35ec-b06f-415b-8263-2b57fb8edb39 req-77d80e35-4fa5-439a-9620-60e564872bdd service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:55.373946 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-2f2e35ec-b06f-415b-8263-2b57fb8edb39 req-77d80e35-4fa5-439a-9620-60e564872bdd service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:55.420221 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.compute.server_external_events [req-2f2e35ec-b06f-415b-8263-2b57fb8edb39 req-77d80e35-4fa5-439a-9620-60e564872bdd service nova] Creating event network-changed:9a1fe4fe-80c8-4bb9-aef0-db5351e50d39 for instance b5217ba8-1c7d-4811-bc6f-daeedd5d8d02 on hv-cinder-76019 Feb 17 04:38:55.439674 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [req-2f2e35ec-b06f-415b-8263-2b57fb8edb39 req-77d80e35-4fa5-439a-9620-60e564872bdd service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112503 Feb 17 04:38:55.442145 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 179/368] 10.222.0.38 () {64 vars in 1308 bytes} [Wed Feb 17 04:38:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:38:55.471090 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-a64e46fe-52f7-4e13-8e8a-7c31969f1d60 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:55.476644 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-a64e46fe-52f7-4e13-8e8a-7c31969f1d60 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:55.497858 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a64e46fe-52f7-4e13-8e8a-7c31969f1d60 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:55.506907 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a64e46fe-52f7-4e13-8e8a-7c31969f1d60 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:55.507865 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a64e46fe-52f7-4e13-8e8a-7c31969f1d60 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:55.508379 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a64e46fe-52f7-4e13-8e8a-7c31969f1d60 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:56.483374 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-33a53c40-de46-478d-b763-5e944398e8ad tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:56.506246 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-33a53c40-de46-478d-b763-5e944398e8ad tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c" status: 200 len: 1516 microversion: 2.1 time: 1.381766 Feb 17 04:38:56.509532 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 190/369] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:55 2021] GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c => generated 1516 bytes in 1386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:56.536178 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-f2763f99-1273-417d-ac39-7431e6b953e9 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:56.537153 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-f2763f99-1273-417d-ac39-7431e6b953e9 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] [instance: 63d693d7-4d4a-4013-9ae8-6ab6851111d6] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:56.557341 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f2763f99-1273-417d-ac39-7431e6b953e9 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:56.557852 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f2763f99-1273-417d-ac39-7431e6b953e9 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:56.558745 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f2763f99-1273-417d-ac39-7431e6b953e9 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:56.559506 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f2763f99-1273-417d-ac39-7431e6b953e9 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:56.606596 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-a64e46fe-52f7-4e13-8e8a-7c31969f1d60 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:56.623947 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-a64e46fe-52f7-4e13-8e8a-7c31969f1d60 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:56.628783 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-a64e46fe-52f7-4e13-8e8a-7c31969f1d60 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:56.631946 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-a64e46fe-52f7-4e13-8e8a-7c31969f1d60 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1746 microversion: 2.20 time: 1.188408 Feb 17 04:38:56.635280 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 180/370] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:38:55 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1746 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:38:56.650959 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-738890db-03c6-4772-b4c4-201876090073 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:56.651952 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-738890db-03c6-4772-b4c4-201876090073 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: b5217ba8-1c7d-4811-bc6f-daeedd5d8d02] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:56.667450 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-738890db-03c6-4772-b4c4-201876090073 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:56.668286 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-738890db-03c6-4772-b4c4-201876090073 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:56.669335 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-738890db-03c6-4772-b4c4-201876090073 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:56.673955 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-738890db-03c6-4772-b4c4-201876090073 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:58.077736 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-738890db-03c6-4772-b4c4-201876090073 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a46d18160148f3a48ef4887f6ec7da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6284f2b80524eb0a36ccebaedba767a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:58.088706 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-738890db-03c6-4772-b4c4-201876090073 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "GET /compute/v2.1/servers/b5217ba8-1c7d-4811-bc6f-daeedd5d8d02" status: 200 len: 1318 microversion: 2.1 time: 1.452032 Feb 17 04:38:58.090332 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 181/371] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:56 2021] GET /compute/v2.1/servers/b5217ba8-1c7d-4811-bc6f-daeedd5d8d02 => generated 1318 bytes in 1454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:58.110993 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-ac4ab3d1-d9ca-41bd-b2b8-5aa2df312154 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:58.111665 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-ac4ab3d1-d9ca-41bd-b2b8-5aa2df312154 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:58.134712 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ac4ab3d1-d9ca-41bd-b2b8-5aa2df312154 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:58.135225 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ac4ab3d1-d9ca-41bd-b2b8-5aa2df312154 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:58.140495 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ac4ab3d1-d9ca-41bd-b2b8-5aa2df312154 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:58.141212 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ac4ab3d1-d9ca-41bd-b2b8-5aa2df312154 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:58.476018 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-f2763f99-1273-417d-ac39-7431e6b953e9 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dbfaa95e04439c8cef3a3cda68bae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326ff5fa6a514a2c88e810faa7b0b6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:58.493260 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-f2763f99-1273-417d-ac39-7431e6b953e9 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] 10.222.0.38 "GET /compute/v2.1/servers/63d693d7-4d4a-4013-9ae8-6ab6851111d6" status: 200 len: 1314 microversion: 2.1 time: 1.980767 Feb 17 04:38:58.495301 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 191/372] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:56 2021] GET /compute/v2.1/servers/63d693d7-4d4a-4013-9ae8-6ab6851111d6 => generated 1314 bytes in 1985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:58.508309 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-1b73d205-6e9b-43eb-9d7a-de47d0f17565 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cb48e264-e08c-4448-8b51-db70311de855", "device": "/dev/sdb"}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:38:58.510414 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-1b73d205-6e9b-43eb-9d7a-de47d0f17565 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] [instance: d9d6e198-85f5-488e-8317-d498205f37cc] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:58.530191 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1b73d205-6e9b-43eb-9d7a-de47d0f17565 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:58.531107 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1b73d205-6e9b-43eb-9d7a-de47d0f17565 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:58.533345 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1b73d205-6e9b-43eb-9d7a-de47d0f17565 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:58.537087 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1b73d205-6e9b-43eb-9d7a-de47d0f17565 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:58.908299 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-ac4ab3d1-d9ca-41bd-b2b8-5aa2df312154 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:58.943149 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-ac4ab3d1-d9ca-41bd-b2b8-5aa2df312154 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:58.945987 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-ac4ab3d1-d9ca-41bd-b2b8-5aa2df312154 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:58.966223 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-ac4ab3d1-d9ca-41bd-b2b8-5aa2df312154 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1746 microversion: 2.20 time: 0.873991 Feb 17 04:38:58.972809 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 182/373] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:38:58 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1746 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:38:58.993663 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-84886840-9d43-449f-950d-a7454733b65d tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:58.994521 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-84886840-9d43-449f-950d-a7454733b65d tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 68a5c561-c418-4a68-b8b3-1600b638b80c] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:59.009860 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-84886840-9d43-449f-950d-a7454733b65d tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:59.012621 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-84886840-9d43-449f-950d-a7454733b65d tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:59.013637 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-84886840-9d43-449f-950d-a7454733b65d tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:59.015936 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-84886840-9d43-449f-950d-a7454733b65d tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:59.522797 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-1b73d205-6e9b-43eb-9d7a-de47d0f17565 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] 10.222.0.38 "POST /compute/v2.1/servers/d9d6e198-85f5-488e-8317-d498205f37cc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.025725 Feb 17 04:38:59.523397 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 192/374] 10.222.0.38 () {60 vars in 1313 bytes} [Wed Feb 17 04:38:58 2021] POST /compute/v2.1/servers/d9d6e198-85f5-488e-8317-d498205f37cc/os-volume_attachments => generated 194 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:38:59.537112 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-34365855-86d8-4b42-9aab-a69f19369dcc tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:59.537892 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-34365855-86d8-4b42-9aab-a69f19369dcc tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: b5217ba8-1c7d-4811-bc6f-daeedd5d8d02] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:59.602249 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-84886840-9d43-449f-950d-a7454733b65d tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:38:59.623680 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-34365855-86d8-4b42-9aab-a69f19369dcc tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:59.624018 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-34365855-86d8-4b42-9aab-a69f19369dcc tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:59.624885 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-34365855-86d8-4b42-9aab-a69f19369dcc tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:59.625385 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-34365855-86d8-4b42-9aab-a69f19369dcc tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:59.632961 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-84886840-9d43-449f-950d-a7454733b65d tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c" status: 200 len: 1516 microversion: 2.1 time: 0.652604 Feb 17 04:38:59.633925 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 183/375] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:58 2021] GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c => generated 1516 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:38:59.641013 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-0c945560-99b0-4735-8c09-d6dae46da7e9 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:38:59.644801 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-0c945560-99b0-4735-8c09-d6dae46da7e9 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] [instance: 63d693d7-4d4a-4013-9ae8-6ab6851111d6] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:38:59.669548 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0c945560-99b0-4735-8c09-d6dae46da7e9 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:59.674153 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0c945560-99b0-4735-8c09-d6dae46da7e9 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:38:59.676612 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0c945560-99b0-4735-8c09-d6dae46da7e9 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:38:59.678508 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0c945560-99b0-4735-8c09-d6dae46da7e9 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:00.421982 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-0c945560-99b0-4735-8c09-d6dae46da7e9 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dbfaa95e04439c8cef3a3cda68bae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326ff5fa6a514a2c88e810faa7b0b6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:00.435759 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-0c945560-99b0-4735-8c09-d6dae46da7e9 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] 10.222.0.38 "GET /compute/v2.1/servers/63d693d7-4d4a-4013-9ae8-6ab6851111d6" status: 200 len: 1314 microversion: 2.1 time: 0.799611 Feb 17 04:39:00.437061 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 184/376] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:59 2021] GET /compute/v2.1/servers/63d693d7-4d4a-4013-9ae8-6ab6851111d6 => generated 1314 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:00.444496 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-00fa8133-20a1-4862-9deb-069739722417 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9becb80b-6cb9-4cb4-a1ba-3fe9a5a5c011"}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:00.447671 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-00fa8133-20a1-4862-9deb-069739722417 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 68a5c561-c418-4a68-b8b3-1600b638b80c] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:00.456944 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-00fa8133-20a1-4862-9deb-069739722417 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:00.458089 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-34365855-86d8-4b42-9aab-a69f19369dcc tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a46d18160148f3a48ef4887f6ec7da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6284f2b80524eb0a36ccebaedba767a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:00.458355 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-00fa8133-20a1-4862-9deb-069739722417 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:00.459500 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-00fa8133-20a1-4862-9deb-069739722417 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:00.460151 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-00fa8133-20a1-4862-9deb-069739722417 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:00.468790 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-34365855-86d8-4b42-9aab-a69f19369dcc tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "GET /compute/v2.1/servers/b5217ba8-1c7d-4811-bc6f-daeedd5d8d02" status: 200 len: 1318 microversion: 2.1 time: 0.936333 Feb 17 04:39:00.469609 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 193/377] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:38:59 2021] GET /compute/v2.1/servers/b5217ba8-1c7d-4811-bc6f-daeedd5d8d02 => generated 1318 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:00.483779 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-00c7a28a-4d95-40c2-b107-cdaa62697ad0 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:00.484515 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-00c7a28a-4d95-40c2-b107-cdaa62697ad0 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:00.494532 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-00c7a28a-4d95-40c2-b107-cdaa62697ad0 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:00.495296 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-00c7a28a-4d95-40c2-b107-cdaa62697ad0 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:00.496319 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-00c7a28a-4d95-40c2-b107-cdaa62697ad0 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:00.497126 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-00c7a28a-4d95-40c2-b107-cdaa62697ad0 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:00.794944 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-00c7a28a-4d95-40c2-b107-cdaa62697ad0 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:00.808944 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-00c7a28a-4d95-40c2-b107-cdaa62697ad0 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:00.810921 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-00c7a28a-4d95-40c2-b107-cdaa62697ad0 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:00.812148 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-00c7a28a-4d95-40c2-b107-cdaa62697ad0 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1741 microversion: 2.20 time: 0.341294 Feb 17 04:39:00.812754 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 194/378] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:39:00 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1741 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:39:01.327515 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-00fa8133-20a1-4862-9deb-069739722417 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "POST /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.887759 Feb 17 04:39:01.328557 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 185/379] 10.222.0.38 () {60 vars in 1313 bytes} [Wed Feb 17 04:39:00 2021] POST /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c/os-volume_attachments => generated 194 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:39:01.455816 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-6c9dab79-942d-4aae-a062-79c88e0c43ac tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:01.457357 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-6c9dab79-942d-4aae-a062-79c88e0c43ac tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] [instance: 63d693d7-4d4a-4013-9ae8-6ab6851111d6] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:01.477894 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6c9dab79-942d-4aae-a062-79c88e0c43ac tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:01.478333 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6c9dab79-942d-4aae-a062-79c88e0c43ac tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:01.479229 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6c9dab79-942d-4aae-a062-79c88e0c43ac tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:01.479731 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6c9dab79-942d-4aae-a062-79c88e0c43ac tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:01.489804 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-85da7250-4890-421e-8bbb-3ed2fae9105b tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:01.490600 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-85da7250-4890-421e-8bbb-3ed2fae9105b tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: b5217ba8-1c7d-4811-bc6f-daeedd5d8d02] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:01.518900 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-85da7250-4890-421e-8bbb-3ed2fae9105b tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:01.519623 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-85da7250-4890-421e-8bbb-3ed2fae9105b tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:01.520761 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-85da7250-4890-421e-8bbb-3ed2fae9105b tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:01.521263 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-85da7250-4890-421e-8bbb-3ed2fae9105b tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:02.173413 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-85da7250-4890-421e-8bbb-3ed2fae9105b tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a46d18160148f3a48ef4887f6ec7da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6284f2b80524eb0a36ccebaedba767a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:02.188861 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-85da7250-4890-421e-8bbb-3ed2fae9105b tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "GET /compute/v2.1/servers/b5217ba8-1c7d-4811-bc6f-daeedd5d8d02" status: 200 len: 1318 microversion: 2.1 time: 0.698066 Feb 17 04:39:02.189578 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 186/380] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:01 2021] GET /compute/v2.1/servers/b5217ba8-1c7d-4811-bc6f-daeedd5d8d02 => generated 1318 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:02.197486 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-154fd8e1-0726-468a-8693-c5742f4f2164 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:02.198156 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-154fd8e1-0726-468a-8693-c5742f4f2164 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:02.226286 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-154fd8e1-0726-468a-8693-c5742f4f2164 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:02.227265 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-154fd8e1-0726-468a-8693-c5742f4f2164 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:02.229515 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-154fd8e1-0726-468a-8693-c5742f4f2164 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:02.230642 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-154fd8e1-0726-468a-8693-c5742f4f2164 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:02.275746 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-6c9dab79-942d-4aae-a062-79c88e0c43ac tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dbfaa95e04439c8cef3a3cda68bae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326ff5fa6a514a2c88e810faa7b0b6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:02.287982 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-6c9dab79-942d-4aae-a062-79c88e0c43ac tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] 10.222.0.38 "GET /compute/v2.1/servers/63d693d7-4d4a-4013-9ae8-6ab6851111d6" status: 200 len: 1314 microversion: 2.1 time: 0.836468 Feb 17 04:39:02.302668 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 195/381] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:01 2021] GET /compute/v2.1/servers/63d693d7-4d4a-4013-9ae8-6ab6851111d6 => generated 1314 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:02.358817 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [req-d45127a4-6c09-4e4d-b12f-008e4be617ad req-fa211fe9-7127-4231-8623-0ef06d499683 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63d693d7-4d4a-4013-9ae8-6ab6851111d6", "name": "network-vif-plugged", "status": "completed", "tag": "e12100f6-dd98-4a5d-b88d-cfacc2029e5d"}]} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:02.363840 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:39:02.363840 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:39:02.387165 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-d45127a4-6c09-4e4d-b12f-008e4be617ad req-fa211fe9-7127-4231-8623-0ef06d499683 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:02.387839 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-d45127a4-6c09-4e4d-b12f-008e4be617ad req-fa211fe9-7127-4231-8623-0ef06d499683 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:02.431204 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.compute.server_external_events [req-d45127a4-6c09-4e4d-b12f-008e4be617ad req-fa211fe9-7127-4231-8623-0ef06d499683 service nova] Creating event network-vif-plugged:e12100f6-dd98-4a5d-b88d-cfacc2029e5d for instance 63d693d7-4d4a-4013-9ae8-6ab6851111d6 on hv-cinder-76019 Feb 17 04:39:02.451142 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [req-d45127a4-6c09-4e4d-b12f-008e4be617ad req-fa211fe9-7127-4231-8623-0ef06d499683 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096654 Feb 17 04:39:02.453723 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 196/382] 10.222.0.38 () {64 vars in 1308 bytes} [Wed Feb 17 04:39:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:39:02.723962 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-154fd8e1-0726-468a-8693-c5742f4f2164 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:02.741955 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-154fd8e1-0726-468a-8693-c5742f4f2164 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:02.743551 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-154fd8e1-0726-468a-8693-c5742f4f2164 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:02.755941 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-154fd8e1-0726-468a-8693-c5742f4f2164 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1741 microversion: 2.20 time: 0.553240 Feb 17 04:39:02.756643 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 187/383] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:39:02 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1741 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:39:03.208507 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-c658f005-4dba-4170-98ec-89e7c67c6712 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:03.209274 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-c658f005-4dba-4170-98ec-89e7c67c6712 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: b5217ba8-1c7d-4811-bc6f-daeedd5d8d02] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:03.227477 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c658f005-4dba-4170-98ec-89e7c67c6712 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:03.227983 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c658f005-4dba-4170-98ec-89e7c67c6712 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:03.228843 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c658f005-4dba-4170-98ec-89e7c67c6712 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:03.229332 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c658f005-4dba-4170-98ec-89e7c67c6712 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:03.306935 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-fbdedd7b-3471-43c5-946b-091b8b798c31 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:03.307589 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-fbdedd7b-3471-43c5-946b-091b8b798c31 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] [instance: 63d693d7-4d4a-4013-9ae8-6ab6851111d6] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:03.330341 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-fbdedd7b-3471-43c5-946b-091b8b798c31 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:03.331454 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-fbdedd7b-3471-43c5-946b-091b8b798c31 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:03.332404 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-fbdedd7b-3471-43c5-946b-091b8b798c31 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:03.332899 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-fbdedd7b-3471-43c5-946b-091b8b798c31 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:04.035748 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-fbdedd7b-3471-43c5-946b-091b8b798c31 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dbfaa95e04439c8cef3a3cda68bae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326ff5fa6a514a2c88e810faa7b0b6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:04.049197 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-fbdedd7b-3471-43c5-946b-091b8b798c31 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] 10.222.0.38 "GET /compute/v2.1/servers/63d693d7-4d4a-4013-9ae8-6ab6851111d6" status: 200 len: 1314 microversion: 2.1 time: 0.746174 Feb 17 04:39:04.056786 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-c658f005-4dba-4170-98ec-89e7c67c6712 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a46d18160148f3a48ef4887f6ec7da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6284f2b80524eb0a36ccebaedba767a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:04.057622 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 188/384] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:03 2021] GET /compute/v2.1/servers/63d693d7-4d4a-4013-9ae8-6ab6851111d6 => generated 1314 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:04.070436 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-c658f005-4dba-4170-98ec-89e7c67c6712 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "GET /compute/v2.1/servers/b5217ba8-1c7d-4811-bc6f-daeedd5d8d02" status: 200 len: 1318 microversion: 2.1 time: 0.866552 Feb 17 04:39:04.072382 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-a2184d16-db0d-470b-b5d2-a64791b97499 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:04.073062 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-a2184d16-db0d-470b-b5d2-a64791b97499 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:04.075688 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 197/385] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:03 2021] GET /compute/v2.1/servers/b5217ba8-1c7d-4811-bc6f-daeedd5d8d02 => generated 1318 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:04.094063 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a2184d16-db0d-470b-b5d2-a64791b97499 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:04.098665 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a2184d16-db0d-470b-b5d2-a64791b97499 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:04.099739 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a2184d16-db0d-470b-b5d2-a64791b97499 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:04.104202 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a2184d16-db0d-470b-b5d2-a64791b97499 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:04.531128 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-a2184d16-db0d-470b-b5d2-a64791b97499 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:04.553319 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-a2184d16-db0d-470b-b5d2-a64791b97499 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:04.555439 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-a2184d16-db0d-470b-b5d2-a64791b97499 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:04.561819 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-a2184d16-db0d-470b-b5d2-a64791b97499 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1741 microversion: 2.20 time: 0.498013 Feb 17 04:39:04.563149 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 189/386] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:39:04 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1741 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:39:04.625750 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [req-ad61a534-77b7-4b97-8d81-338da8a2e1db req-310d6c0e-5639-4390-86fb-f0547bcec8b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5217ba8-1c7d-4811-bc6f-daeedd5d8d02", "name": "network-vif-plugged", "status": "completed", "tag": "9a1fe4fe-80c8-4bb9-aef0-db5351e50d39"}]} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:04.629407 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:39:04.629407 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:39:04.659535 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-ad61a534-77b7-4b97-8d81-338da8a2e1db req-310d6c0e-5639-4390-86fb-f0547bcec8b8 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:04.668925 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-ad61a534-77b7-4b97-8d81-338da8a2e1db req-310d6c0e-5639-4390-86fb-f0547bcec8b8 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:04.742871 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.compute.server_external_events [req-ad61a534-77b7-4b97-8d81-338da8a2e1db req-310d6c0e-5639-4390-86fb-f0547bcec8b8 service nova] Creating event network-vif-plugged:9a1fe4fe-80c8-4bb9-aef0-db5351e50d39 for instance b5217ba8-1c7d-4811-bc6f-daeedd5d8d02 on hv-cinder-76019 Feb 17 04:39:04.754418 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [req-ad61a534-77b7-4b97-8d81-338da8a2e1db req-310d6c0e-5639-4390-86fb-f0547bcec8b8 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133109 Feb 17 04:39:04.755372 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 198/387] 10.222.0.38 () {64 vars in 1308 bytes} [Wed Feb 17 04:39:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:39:05.082178 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-d1920c62-1bf7-4330-be9f-6d9211716f1c tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:05.082975 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-d1920c62-1bf7-4330-be9f-6d9211716f1c tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] [instance: 63d693d7-4d4a-4013-9ae8-6ab6851111d6] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:05.093848 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-8afa7505-c1c4-4df3-a7e9-4400c9f897df tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:05.095012 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-8afa7505-c1c4-4df3-a7e9-4400c9f897df tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: b5217ba8-1c7d-4811-bc6f-daeedd5d8d02] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:05.106880 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d1920c62-1bf7-4330-be9f-6d9211716f1c tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:05.113170 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d1920c62-1bf7-4330-be9f-6d9211716f1c tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:05.114228 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d1920c62-1bf7-4330-be9f-6d9211716f1c tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:05.114778 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d1920c62-1bf7-4330-be9f-6d9211716f1c tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:05.115709 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8afa7505-c1c4-4df3-a7e9-4400c9f897df tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:05.119099 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8afa7505-c1c4-4df3-a7e9-4400c9f897df tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:05.123441 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8afa7505-c1c4-4df3-a7e9-4400c9f897df tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:05.124959 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8afa7505-c1c4-4df3-a7e9-4400c9f897df tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:05.599855 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-d1920c62-1bf7-4330-be9f-6d9211716f1c tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dbfaa95e04439c8cef3a3cda68bae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326ff5fa6a514a2c88e810faa7b0b6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:05.613837 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-d1920c62-1bf7-4330-be9f-6d9211716f1c tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] 10.222.0.38 "GET /compute/v2.1/servers/63d693d7-4d4a-4013-9ae8-6ab6851111d6" status: 200 len: 1463 microversion: 2.1 time: 0.541307 Feb 17 04:39:05.619421 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 190/388] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:05 2021] GET /compute/v2.1/servers/63d693d7-4d4a-4013-9ae8-6ab6851111d6 => generated 1463 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:05.624882 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-2bb13cf0-8613-4edf-acdc-4542c9027f44 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:05.632450 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-2bb13cf0-8613-4edf-acdc-4542c9027f44 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:05.660967 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2bb13cf0-8613-4edf-acdc-4542c9027f44 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:05.661870 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2bb13cf0-8613-4edf-acdc-4542c9027f44 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:05.662997 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2bb13cf0-8613-4edf-acdc-4542c9027f44 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:05.663650 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2bb13cf0-8613-4edf-acdc-4542c9027f44 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:05.898914 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-8afa7505-c1c4-4df3-a7e9-4400c9f897df tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a46d18160148f3a48ef4887f6ec7da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6284f2b80524eb0a36ccebaedba767a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:05.912834 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-8afa7505-c1c4-4df3-a7e9-4400c9f897df tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "GET /compute/v2.1/servers/b5217ba8-1c7d-4811-bc6f-daeedd5d8d02" status: 200 len: 1318 microversion: 2.1 time: 0.822963 Feb 17 04:39:05.916472 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 199/389] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:05 2021] GET /compute/v2.1/servers/b5217ba8-1c7d-4811-bc6f-daeedd5d8d02 => generated 1318 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:05.931126 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-55566502-ee86-4124-9748-3eee5165035e tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:05.931783 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-55566502-ee86-4124-9748-3eee5165035e tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] [instance: 63d693d7-4d4a-4013-9ae8-6ab6851111d6] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:05.965605 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-55566502-ee86-4124-9748-3eee5165035e tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:05.966110 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-55566502-ee86-4124-9748-3eee5165035e tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:05.977958 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-55566502-ee86-4124-9748-3eee5165035e tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:05.978483 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-55566502-ee86-4124-9748-3eee5165035e tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:06.141837 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-2bb13cf0-8613-4edf-acdc-4542c9027f44 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:06.152376 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-55566502-ee86-4124-9748-3eee5165035e tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] [instance: 63d693d7-4d4a-4013-9ae8-6ab6851111d6] Going to try to terminate instance {{(pid=98080) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 04:39:06.165681 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-2bb13cf0-8613-4edf-acdc-4542c9027f44 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:06.167303 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-2bb13cf0-8613-4edf-acdc-4542c9027f44 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:06.168579 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-2bb13cf0-8613-4edf-acdc-4542c9027f44 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1741 microversion: 2.20 time: 0.547729 Feb 17 04:39:06.169407 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 191/390] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:39:05 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1741 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:39:06.584503 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-55566502-ee86-4124-9748-3eee5165035e tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] 10.222.0.38 "DELETE /compute/v2.1/servers/63d693d7-4d4a-4013-9ae8-6ab6851111d6" status: 204 len: 0 microversion: 2.1 time: 0.666524 Feb 17 04:39:06.585155 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 200/391] 10.222.0.38 () {58 vars in 1229 bytes} [Wed Feb 17 04:39:05 2021] DELETE /compute/v2.1/servers/63d693d7-4d4a-4013-9ae8-6ab6851111d6 => generated 0 bytes in 668 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 17 04:39:06.594631 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-58ea9c3e-80ed-4b2b-b028-1226a0c43c9d tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:06.595508 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-58ea9c3e-80ed-4b2b-b028-1226a0c43c9d tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] [instance: 63d693d7-4d4a-4013-9ae8-6ab6851111d6] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:06.608815 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-58ea9c3e-80ed-4b2b-b028-1226a0c43c9d tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:06.611232 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-58ea9c3e-80ed-4b2b-b028-1226a0c43c9d tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:06.615766 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-58ea9c3e-80ed-4b2b-b028-1226a0c43c9d tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:06.616484 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-58ea9c3e-80ed-4b2b-b028-1226a0c43c9d tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:06.931168 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-e5c80697-a9dc-40e0-8dc7-990cf433d975 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:06.932252 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-e5c80697-a9dc-40e0-8dc7-990cf433d975 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: b5217ba8-1c7d-4811-bc6f-daeedd5d8d02] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:06.948984 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e5c80697-a9dc-40e0-8dc7-990cf433d975 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:06.949867 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e5c80697-a9dc-40e0-8dc7-990cf433d975 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:06.950951 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e5c80697-a9dc-40e0-8dc7-990cf433d975 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:06.952988 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e5c80697-a9dc-40e0-8dc7-990cf433d975 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:06.973146 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-58ea9c3e-80ed-4b2b-b028-1226a0c43c9d tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dbfaa95e04439c8cef3a3cda68bae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326ff5fa6a514a2c88e810faa7b0b6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:06.988626 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-58ea9c3e-80ed-4b2b-b028-1226a0c43c9d tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] 10.222.0.38 "GET /compute/v2.1/servers/63d693d7-4d4a-4013-9ae8-6ab6851111d6" status: 200 len: 1469 microversion: 2.1 time: 0.398695 Feb 17 04:39:07.001205 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 192/392] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:06 2021] GET /compute/v2.1/servers/63d693d7-4d4a-4013-9ae8-6ab6851111d6 => generated 1469 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:07.191097 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-37d52d00-e5f4-4b5d-a9d6-2f06cd2fb57b tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:07.192103 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-37d52d00-e5f4-4b5d-a9d6-2f06cd2fb57b tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:07.207723 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-37d52d00-e5f4-4b5d-a9d6-2f06cd2fb57b tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:07.208523 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-37d52d00-e5f4-4b5d-a9d6-2f06cd2fb57b tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:07.209612 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-37d52d00-e5f4-4b5d-a9d6-2f06cd2fb57b tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:07.220447 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-37d52d00-e5f4-4b5d-a9d6-2f06cd2fb57b tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:07.240952 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-e5c80697-a9dc-40e0-8dc7-990cf433d975 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a46d18160148f3a48ef4887f6ec7da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6284f2b80524eb0a36ccebaedba767a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:07.250984 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-e5c80697-a9dc-40e0-8dc7-990cf433d975 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "GET /compute/v2.1/servers/b5217ba8-1c7d-4811-bc6f-daeedd5d8d02" status: 200 len: 1318 microversion: 2.1 time: 0.324256 Feb 17 04:39:07.252277 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 201/393] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:06 2021] GET /compute/v2.1/servers/b5217ba8-1c7d-4811-bc6f-daeedd5d8d02 => generated 1318 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:39:07.586452 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-37d52d00-e5f4-4b5d-a9d6-2f06cd2fb57b tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:07.607219 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-37d52d00-e5f4-4b5d-a9d6-2f06cd2fb57b tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:07.611216 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-37d52d00-e5f4-4b5d-a9d6-2f06cd2fb57b tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:07.621429 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-37d52d00-e5f4-4b5d-a9d6-2f06cd2fb57b tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1741 microversion: 2.20 time: 0.434800 Feb 17 04:39:07.622172 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 193/394] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:39:07 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1741 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:39:08.020822 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-15c68887-1a15-4999-be1c-c0d95df6a8aa tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:08.021901 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-15c68887-1a15-4999-be1c-c0d95df6a8aa tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] [instance: 63d693d7-4d4a-4013-9ae8-6ab6851111d6] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:08.038466 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-15c68887-1a15-4999-be1c-c0d95df6a8aa tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:08.040894 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-15c68887-1a15-4999-be1c-c0d95df6a8aa tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:08.042113 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-15c68887-1a15-4999-be1c-c0d95df6a8aa tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:08.042853 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-15c68887-1a15-4999-be1c-c0d95df6a8aa tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:08.270084 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-c22974f8-268a-4afe-9374-6b45ca88fdbe tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:08.270784 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-c22974f8-268a-4afe-9374-6b45ca88fdbe tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: b5217ba8-1c7d-4811-bc6f-daeedd5d8d02] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:08.287366 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c22974f8-268a-4afe-9374-6b45ca88fdbe tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:08.287881 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c22974f8-268a-4afe-9374-6b45ca88fdbe tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:08.294433 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c22974f8-268a-4afe-9374-6b45ca88fdbe tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:08.294991 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c22974f8-268a-4afe-9374-6b45ca88fdbe tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:08.526617 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-15c68887-1a15-4999-be1c-c0d95df6a8aa tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dbfaa95e04439c8cef3a3cda68bae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326ff5fa6a514a2c88e810faa7b0b6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:08.541788 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-15c68887-1a15-4999-be1c-c0d95df6a8aa tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] 10.222.0.38 "GET /compute/v2.1/servers/63d693d7-4d4a-4013-9ae8-6ab6851111d6" status: 200 len: 1469 microversion: 2.1 time: 0.525613 Feb 17 04:39:08.542410 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 202/395] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:08 2021] GET /compute/v2.1/servers/63d693d7-4d4a-4013-9ae8-6ab6851111d6 => generated 1469 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:08.641416 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-889a1085-6dde-4ea5-9a59-69b7b7a66abc tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:08.642095 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-889a1085-6dde-4ea5-9a59-69b7b7a66abc tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:08.660217 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-889a1085-6dde-4ea5-9a59-69b7b7a66abc tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:08.660746 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-889a1085-6dde-4ea5-9a59-69b7b7a66abc tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:08.661624 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-889a1085-6dde-4ea5-9a59-69b7b7a66abc tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:08.662126 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-889a1085-6dde-4ea5-9a59-69b7b7a66abc tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:08.731329 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-c22974f8-268a-4afe-9374-6b45ca88fdbe tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a46d18160148f3a48ef4887f6ec7da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6284f2b80524eb0a36ccebaedba767a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:08.749491 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-c22974f8-268a-4afe-9374-6b45ca88fdbe tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "GET /compute/v2.1/servers/b5217ba8-1c7d-4811-bc6f-daeedd5d8d02" status: 200 len: 1508 microversion: 2.1 time: 0.483866 Feb 17 04:39:08.750116 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 194/396] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:08 2021] GET /compute/v2.1/servers/b5217ba8-1c7d-4811-bc6f-daeedd5d8d02 => generated 1508 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:08.997205 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-889a1085-6dde-4ea5-9a59-69b7b7a66abc tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:09.008385 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-889a1085-6dde-4ea5-9a59-69b7b7a66abc tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:09.010035 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-889a1085-6dde-4ea5-9a59-69b7b7a66abc tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:09.011602 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-889a1085-6dde-4ea5-9a59-69b7b7a66abc tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1741 microversion: 2.20 time: 0.374105 Feb 17 04:39:09.012637 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 203/397] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:39:08 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1741 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 04:39:09.562257 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-14b39408-94df-4890-8cd7-0c5238290daa tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:09.562962 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-14b39408-94df-4890-8cd7-0c5238290daa tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] [instance: 63d693d7-4d4a-4013-9ae8-6ab6851111d6] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:09.586229 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-14b39408-94df-4890-8cd7-0c5238290daa tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:09.587322 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-14b39408-94df-4890-8cd7-0c5238290daa tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:09.588451 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-14b39408-94df-4890-8cd7-0c5238290daa tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:09.589489 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-14b39408-94df-4890-8cd7-0c5238290daa tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:10.039164 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-da59448d-6bf3-41d5-ab21-7c0ebb4d3f48 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:10.041176 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-da59448d-6bf3-41d5-ab21-7c0ebb4d3f48 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:10.076832 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-da59448d-6bf3-41d5-ab21-7c0ebb4d3f48 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:10.083411 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-da59448d-6bf3-41d5-ab21-7c0ebb4d3f48 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:10.084697 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-da59448d-6bf3-41d5-ab21-7c0ebb4d3f48 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:10.109815 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-da59448d-6bf3-41d5-ab21-7c0ebb4d3f48 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:11.243248 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-14b39408-94df-4890-8cd7-0c5238290daa tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dbfaa95e04439c8cef3a3cda68bae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326ff5fa6a514a2c88e810faa7b0b6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:11.263888 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-14b39408-94df-4890-8cd7-0c5238290daa tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] 10.222.0.38 "GET /compute/v2.1/servers/63d693d7-4d4a-4013-9ae8-6ab6851111d6" status: 200 len: 1469 microversion: 2.1 time: 1.706369 Feb 17 04:39:11.268713 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-da59448d-6bf3-41d5-ab21-7c0ebb4d3f48 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:11.269654 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 195/398] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:09 2021] GET /compute/v2.1/servers/63d693d7-4d4a-4013-9ae8-6ab6851111d6 => generated 1469 bytes in 1713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:11.285840 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [req-a4d1ced6-31d5-49fb-8bdd-b65dc0b310a5 req-7c898856-f1ce-4fce-9b8c-75df867573c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63d693d7-4d4a-4013-9ae8-6ab6851111d6", "name": "network-vif-unplugged", "status": "completed", "tag": "e12100f6-dd98-4a5d-b88d-cfacc2029e5d"}]} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:11.288936 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-da59448d-6bf3-41d5-ab21-7c0ebb4d3f48 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:11.289297 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-da59448d-6bf3-41d5-ab21-7c0ebb4d3f48 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:11.290516 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-da59448d-6bf3-41d5-ab21-7c0ebb4d3f48 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1741 microversion: 2.20 time: 1.257310 Feb 17 04:39:11.302591 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 204/399] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:39:10 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1741 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:39:11.312623 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-17db89cc-3dc5-4880-be7a-b7e614e2f658 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4d0c2b76-d6e5-4765-bba2-318e7aad424c"}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:11.312623 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-17db89cc-3dc5-4880-be7a-b7e614e2f658 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: b5217ba8-1c7d-4811-bc6f-daeedd5d8d02] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:11.314290 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:39:11.314290 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:39:11.334417 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-17db89cc-3dc5-4880-be7a-b7e614e2f658 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:11.334961 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-17db89cc-3dc5-4880-be7a-b7e614e2f658 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:11.335827 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-17db89cc-3dc5-4880-be7a-b7e614e2f658 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:11.336329 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-17db89cc-3dc5-4880-be7a-b7e614e2f658 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:11.338547 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-a4d1ced6-31d5-49fb-8bdd-b65dc0b310a5 req-7c898856-f1ce-4fce-9b8c-75df867573c2 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:11.341896 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-a4d1ced6-31d5-49fb-8bdd-b65dc0b310a5 req-7c898856-f1ce-4fce-9b8c-75df867573c2 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:11.368397 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.compute.server_external_events [req-a4d1ced6-31d5-49fb-8bdd-b65dc0b310a5 req-7c898856-f1ce-4fce-9b8c-75df867573c2 service nova] Creating event network-vif-unplugged:e12100f6-dd98-4a5d-b88d-cfacc2029e5d for instance 63d693d7-4d4a-4013-9ae8-6ab6851111d6 on hv-cinder-76019 Feb 17 04:39:11.374055 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [req-a4d1ced6-31d5-49fb-8bdd-b65dc0b310a5 req-7c898856-f1ce-4fce-9b8c-75df867573c2 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.096435 Feb 17 04:39:11.380934 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 196/400] 10.222.0.38 () {64 vars in 1308 bytes} [Wed Feb 17 04:39:11 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:39:11.943606 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-0cad3769-404d-4769-8bc2-5772479ad799 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Action: 'create', calling method: .version_select at 0x7fc2e9f750d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-693993925"}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:11.974915 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.quota [None req-0cad3769-404d-4769-8bc2-5772479ad799 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Getting quotas for project e57600d4d269474ab7d2f3e7ebf528ac. Resources: {'key_pairs'} {{(pid=98081) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:39:11.983971 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.quota [None req-0cad3769-404d-4769-8bc2-5772479ad799 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Getting quotas for user 190727a0bed54b52913aa6aa1ff8cea4 and project e57600d4d269474ab7d2f3e7ebf528ac. Resources: {'key_pairs'} {{(pid=98081) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:39:12.365313 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.quota [None req-0cad3769-404d-4769-8bc2-5772479ad799 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Getting quotas for project e57600d4d269474ab7d2f3e7ebf528ac. Resources: {'key_pairs'} {{(pid=98081) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:39:12.369967 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.quota [None req-0cad3769-404d-4769-8bc2-5772479ad799 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Getting quotas for user 190727a0bed54b52913aa6aa1ff8cea4 and project e57600d4d269474ab7d2f3e7ebf528ac. Resources: {'key_pairs'} {{(pid=98081) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:39:12.386605 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-0cad3769-404d-4769-8bc2-5772479ad799 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] 10.222.0.38 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 0.449500 Feb 17 04:39:12.386976 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 197/401] 10.222.0.38 () {60 vars in 1148 bytes} [Wed Feb 17 04:39:11 2021] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:12.392207 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-d7620acf-f275-4aa3-a320-6994abaaf690 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:12.394022 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-d7620acf-f275-4aa3-a320-6994abaaf690 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] [instance: 63d693d7-4d4a-4013-9ae8-6ab6851111d6] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:12.402943 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d7620acf-f275-4aa3-a320-6994abaaf690 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:12.403840 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d7620acf-f275-4aa3-a320-6994abaaf690 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:12.405572 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d7620acf-f275-4aa3-a320-6994abaaf690 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:12.405572 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d7620acf-f275-4aa3-a320-6994abaaf690 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:12.675795 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-d7620acf-f275-4aa3-a320-6994abaaf690 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dbfaa95e04439c8cef3a3cda68bae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326ff5fa6a514a2c88e810faa7b0b6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:12.689794 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-d7620acf-f275-4aa3-a320-6994abaaf690 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] 10.222.0.38 "GET /compute/v2.1/servers/63d693d7-4d4a-4013-9ae8-6ab6851111d6" status: 200 len: 1427 microversion: 2.1 time: 0.301418 Feb 17 04:39:12.691402 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 198/402] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:12 2021] GET /compute/v2.1/servers/63d693d7-4d4a-4013-9ae8-6ab6851111d6 => generated 1427 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:12.698114 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-c84af7bf-4c8e-4f1b-aa48-40b0de2918e8 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:12.700572 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-c84af7bf-4c8e-4f1b-aa48-40b0de2918e8 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:12.709942 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c84af7bf-4c8e-4f1b-aa48-40b0de2918e8 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:12.710809 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c84af7bf-4c8e-4f1b-aa48-40b0de2918e8 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:12.711878 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c84af7bf-4c8e-4f1b-aa48-40b0de2918e8 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:12.712675 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c84af7bf-4c8e-4f1b-aa48-40b0de2918e8 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:13.166252 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-c84af7bf-4c8e-4f1b-aa48-40b0de2918e8 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:13.179193 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-c84af7bf-4c8e-4f1b-aa48-40b0de2918e8 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:13.180771 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-c84af7bf-4c8e-4f1b-aa48-40b0de2918e8 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:13.181982 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-c84af7bf-4c8e-4f1b-aa48-40b0de2918e8 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1741 microversion: 2.20 time: 0.489186 Feb 17 04:39:13.182783 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 199/403] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:39:12 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1741 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:39:13.188766 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-e9b586bf-c155-405f-966d-58a0e9af006b tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-836887926", "imageRef": "4dd1d358-b0b0-4efd-bd16-bdce09cf90c1", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-693993925", "networks": [{"uuid": "6867f3e4-ec3d-45b2-9435-bb5e12342eb7"}]}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:13.257902 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.network.neutron [None req-e9b586bf-c155-405f-966d-58a0e9af006b tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] validate_networks() for [('6867f3e4-ec3d-45b2-9435-bb5e12342eb7', None, None, None)] {{(pid=98081) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 04:39:13.900781 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-17db89cc-3dc5-4880-be7a-b7e614e2f658 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "POST /compute/v2.1/servers/b5217ba8-1c7d-4811-bc6f-daeedd5d8d02/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.607751 Feb 17 04:39:13.901586 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 205/404] 10.222.0.38 () {60 vars in 1313 bytes} [Wed Feb 17 04:39:11 2021] POST /compute/v2.1/servers/b5217ba8-1c7d-4811-bc6f-daeedd5d8d02/os-volume_attachments => generated 194 bytes in 2610 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:39:13.907633 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [req-a7122e34-96c3-41ce-9ad3-4318fd4575b4 req-63e9b63b-888b-437a-9d39-7f0dcf805780 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63d693d7-4d4a-4013-9ae8-6ab6851111d6", "name": "network-vif-deleted", "tag": "e12100f6-dd98-4a5d-b88d-cfacc2029e5d"}]} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:13.910710 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:39:13.910710 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:39:13.923576 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-a7122e34-96c3-41ce-9ad3-4318fd4575b4 req-63e9b63b-888b-437a-9d39-7f0dcf805780 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:13.924785 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-a7122e34-96c3-41ce-9ad3-4318fd4575b4 req-63e9b63b-888b-437a-9d39-7f0dcf805780 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:13.956896 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.compute.server_external_events [req-a7122e34-96c3-41ce-9ad3-4318fd4575b4 req-63e9b63b-888b-437a-9d39-7f0dcf805780 service nova] Creating event network-vif-deleted:e12100f6-dd98-4a5d-b88d-cfacc2029e5d for instance 63d693d7-4d4a-4013-9ae8-6ab6851111d6 on hv-cinder-76019 Feb 17 04:39:13.972782 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [req-a7122e34-96c3-41ce-9ad3-4318fd4575b4 req-63e9b63b-888b-437a-9d39-7f0dcf805780 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069113 Feb 17 04:39:13.973964 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 206/405] 10.222.0.38 () {64 vars in 1308 bytes} [Wed Feb 17 04:39:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:39:13.979530 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-89fcf9ea-a3d4-4211-9493-1a5e6116e9a2 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:13.982778 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-89fcf9ea-a3d4-4211-9493-1a5e6116e9a2 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] [instance: 63d693d7-4d4a-4013-9ae8-6ab6851111d6] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:13.992033 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-89fcf9ea-a3d4-4211-9493-1a5e6116e9a2 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:13.992751 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-89fcf9ea-a3d4-4211-9493-1a5e6116e9a2 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:13.994122 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-89fcf9ea-a3d4-4211-9493-1a5e6116e9a2 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:13.995036 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-89fcf9ea-a3d4-4211-9493-1a5e6116e9a2 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:14.077699 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-89fcf9ea-a3d4-4211-9493-1a5e6116e9a2 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:14.078499 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-89fcf9ea-a3d4-4211-9493-1a5e6116e9a2 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:14.079201 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.objects.instance [None req-89fcf9ea-a3d4-4211-9493-1a5e6116e9a2 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Lazy-loading 'fault' on Instance uuid 63d693d7-4d4a-4013-9ae8-6ab6851111d6 {{(pid=98080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:39:14.251589 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-e9b586bf-c155-405f-966d-58a0e9af006b tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Flavor limits 0:0:0 {{(pid=98081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 04:39:14.252852 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-e9b586bf-c155-405f-966d-58a0e9af006b tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Image limits 0:0:0 {{(pid=98081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 04:39:14.253570 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-e9b586bf-c155-405f-966d-58a0e9af006b tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Flavor pref 0:0:0 {{(pid=98081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 04:39:14.254196 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-e9b586bf-c155-405f-966d-58a0e9af006b tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Image pref 0:0:0 {{(pid=98081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 04:39:14.254852 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-e9b586bf-c155-405f-966d-58a0e9af006b tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 04:39:14.269803 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e9b586bf-c155-405f-966d-58a0e9af006b tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:14.272735 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e9b586bf-c155-405f-966d-58a0e9af006b tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:14.275006 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e9b586bf-c155-405f-966d-58a0e9af006b tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:14.275740 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e9b586bf-c155-405f-966d-58a0e9af006b tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:14.284946 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-89fcf9ea-a3d4-4211-9493-1a5e6116e9a2 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dbfaa95e04439c8cef3a3cda68bae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326ff5fa6a514a2c88e810faa7b0b6b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:14.297769 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-89fcf9ea-a3d4-4211-9493-1a5e6116e9a2 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] 10.222.0.38 "GET /compute/v2.1/servers/63d693d7-4d4a-4013-9ae8-6ab6851111d6" status: 200 len: 1304 microversion: 2.1 time: 0.322206 Feb 17 04:39:14.300044 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 207/406] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:13 2021] GET /compute/v2.1/servers/63d693d7-4d4a-4013-9ae8-6ab6851111d6 => generated 1304 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:14.304637 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.quota [None req-e9b586bf-c155-405f-966d-58a0e9af006b tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Getting quotas for project e57600d4d269474ab7d2f3e7ebf528ac. Resources: {'instances', 'cores', 'ram'} {{(pid=98081) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:39:14.307755 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-556925ae-43ab-4170-abcd-788bf7df00a0 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:14.308501 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-556925ae-43ab-4170-abcd-788bf7df00a0 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:14.309891 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.quota [None req-e9b586bf-c155-405f-966d-58a0e9af006b tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Getting quotas for user 190727a0bed54b52913aa6aa1ff8cea4 and project e57600d4d269474ab7d2f3e7ebf528ac. Resources: {'instances', 'cores', 'ram'} {{(pid=98081) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:39:14.319987 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-556925ae-43ab-4170-abcd-788bf7df00a0 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:14.320760 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-556925ae-43ab-4170-abcd-788bf7df00a0 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:14.322067 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-556925ae-43ab-4170-abcd-788bf7df00a0 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:14.322500 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-e9b586bf-c155-405f-966d-58a0e9af006b tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Going to run 1 instances... {{(pid=98081) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 04:39:14.325112 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-e9b586bf-c155-405f-966d-58a0e9af006b tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] [instance: 9231f663-c4c6-4723-8d42-377d3f6dd031] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4dd1d358-b0b0-4efd-bd16-bdce09cf90c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98081) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 04:39:14.340869 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-556925ae-43ab-4170-abcd-788bf7df00a0 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:14.407392 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-e9b586bf-c155-405f-966d-58a0e9af006b tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] 10.222.0.38 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.223603 Feb 17 04:39:14.413999 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 200/407] 10.222.0.38 () {60 vars in 1137 bytes} [Wed Feb 17 04:39:13 2021] POST /compute/v2.1/servers => generated 380 bytes in 1231 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 17 04:39:14.419160 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-b4596570-0641-4758-a1af-4420fac115bb tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:14.420014 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-b4596570-0641-4758-a1af-4420fac115bb tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] [instance: 9231f663-c4c6-4723-8d42-377d3f6dd031] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:14.583008 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-b4596570-0641-4758-a1af-4420fac115bb tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190727a0bed54b52913aa6aa1ff8cea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57600d4d269474ab7d2f3e7ebf528ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:14.596962 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-b4596570-0641-4758-a1af-4420fac115bb tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] 10.222.0.38 "GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031" status: 200 len: 1257 microversion: 2.1 time: 0.180894 Feb 17 04:39:14.597595 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 201/408] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:14 2021] GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031 => generated 1257 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:14.789294 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-556925ae-43ab-4170-abcd-788bf7df00a0 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:14.804356 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-556925ae-43ab-4170-abcd-788bf7df00a0 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:14.806771 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-556925ae-43ab-4170-abcd-788bf7df00a0 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:14.808386 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-556925ae-43ab-4170-abcd-788bf7df00a0 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1741 microversion: 2.20 time: 0.506352 Feb 17 04:39:14.809477 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 208/409] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:39:14 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1741 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:39:15.319341 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-3fcd9148-9f2c-4276-a8d3-d0cd9db3a834 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:15.323070 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-3fcd9148-9f2c-4276-a8d3-d0cd9db3a834 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] [instance: 63d693d7-4d4a-4013-9ae8-6ab6851111d6] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:15.334049 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-3fcd9148-9f2c-4276-a8d3-d0cd9db3a834 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:15.335992 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-3fcd9148-9f2c-4276-a8d3-d0cd9db3a834 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:15.337650 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-3fcd9148-9f2c-4276-a8d3-d0cd9db3a834 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:15.339192 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-3fcd9148-9f2c-4276-a8d3-d0cd9db3a834 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:15.433685 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.wsgi [None req-3fcd9148-9f2c-4276-a8d3-d0cd9db3a834 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] HTTP exception thrown: Instance 63d693d7-4d4a-4013-9ae8-6ab6851111d6 could not be found. Feb 17 04:39:15.435022 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-3fcd9148-9f2c-4276-a8d3-d0cd9db3a834 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] Returning 404 to user: Instance 63d693d7-4d4a-4013-9ae8-6ab6851111d6 could not be found. {{(pid=98081) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:39:15.436130 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-3fcd9148-9f2c-4276-a8d3-d0cd9db3a834 tempest-VolumesNegativeTest-656719010 tempest-VolumesNegativeTest-656719010-project] 10.222.0.38 "GET /compute/v2.1/servers/63d693d7-4d4a-4013-9ae8-6ab6851111d6" status: 404 len: 111 microversion: 2.1 time: 0.122550 Feb 17 04:39:15.445160 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 202/410] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:15 2021] GET /compute/v2.1/servers/63d693d7-4d4a-4013-9ae8-6ab6851111d6 => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 17 04:39:15.615926 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-2571dede-a9b0-4887-9bb5-991e20f3ff4a tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:15.616910 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-2571dede-a9b0-4887-9bb5-991e20f3ff4a tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] [instance: 9231f663-c4c6-4723-8d42-377d3f6dd031] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:15.628249 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2571dede-a9b0-4887-9bb5-991e20f3ff4a tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:15.628776 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2571dede-a9b0-4887-9bb5-991e20f3ff4a tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:15.629627 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2571dede-a9b0-4887-9bb5-991e20f3ff4a tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:15.630301 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2571dede-a9b0-4887-9bb5-991e20f3ff4a tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:15.770597 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-2571dede-a9b0-4887-9bb5-991e20f3ff4a tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190727a0bed54b52913aa6aa1ff8cea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57600d4d269474ab7d2f3e7ebf528ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:15.779616 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-2571dede-a9b0-4887-9bb5-991e20f3ff4a tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] 10.222.0.38 "GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031" status: 200 len: 1253 microversion: 2.1 time: 0.168437 Feb 17 04:39:15.791511 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 209/411] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:15 2021] GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031 => generated 1253 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:15.832589 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-50f6a65e-941c-45a0-8363-fc3207de94d1 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:15.833362 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-50f6a65e-941c-45a0-8363-fc3207de94d1 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:15.841587 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-50f6a65e-941c-45a0-8363-fc3207de94d1 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:15.842384 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-50f6a65e-941c-45a0-8363-fc3207de94d1 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:15.843558 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-50f6a65e-941c-45a0-8363-fc3207de94d1 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:15.844309 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-50f6a65e-941c-45a0-8363-fc3207de94d1 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:16.078110 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-50f6a65e-941c-45a0-8363-fc3207de94d1 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:16.089183 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-50f6a65e-941c-45a0-8363-fc3207de94d1 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:16.090755 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-50f6a65e-941c-45a0-8363-fc3207de94d1 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:16.092172 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-50f6a65e-941c-45a0-8363-fc3207de94d1 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1741 microversion: 2.20 time: 0.264331 Feb 17 04:39:16.092911 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 203/412] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:39:15 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1741 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:39:16.595249 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-ad95329b-f5e9-4b26-ae12-a0e9da605957 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:16.597828 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-ad95329b-f5e9-4b26-ae12-a0e9da605957 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 68a5c561-c418-4a68-b8b3-1600b638b80c] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:16.605714 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ad95329b-f5e9-4b26-ae12-a0e9da605957 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:16.606220 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ad95329b-f5e9-4b26-ae12-a0e9da605957 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:16.607093 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ad95329b-f5e9-4b26-ae12-a0e9da605957 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:16.607562 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ad95329b-f5e9-4b26-ae12-a0e9da605957 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:16.671678 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.objects.instance [None req-ad95329b-f5e9-4b26-ae12-a0e9da605957 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lazy-loading 'flavor' on Instance uuid 68a5c561-c418-4a68-b8b3-1600b638b80c {{(pid=98080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:39:16.800181 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-b18e48d2-1a79-4fc8-b628-a2ae060eb6b0 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:16.801273 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-b18e48d2-1a79-4fc8-b628-a2ae060eb6b0 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] [instance: 9231f663-c4c6-4723-8d42-377d3f6dd031] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:16.812133 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b18e48d2-1a79-4fc8-b628-a2ae060eb6b0 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:16.812649 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b18e48d2-1a79-4fc8-b628-a2ae060eb6b0 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:16.813503 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b18e48d2-1a79-4fc8-b628-a2ae060eb6b0 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:16.814004 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b18e48d2-1a79-4fc8-b628-a2ae060eb6b0 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:16.942957 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-ad95329b-f5e9-4b26-ae12-a0e9da605957 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "POST /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c/action" status: 200 len: 32 microversion: 2.1 time: 0.351682 Feb 17 04:39:16.943754 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 210/413] 10.222.0.38 () {60 vars in 1268 bytes} [Wed Feb 17 04:39:16 2021] POST /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c/action => generated 32 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:39:16.949623 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-b18e48d2-1a79-4fc8-b628-a2ae060eb6b0 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190727a0bed54b52913aa6aa1ff8cea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57600d4d269474ab7d2f3e7ebf528ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:16.965069 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-ec150852-811a-4b8d-95bd-7b3ca82c0dee tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:16.965832 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-ec150852-811a-4b8d-95bd-7b3ca82c0dee tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 68a5c561-c418-4a68-b8b3-1600b638b80c] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:16.970532 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-b18e48d2-1a79-4fc8-b628-a2ae060eb6b0 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] 10.222.0.38 "GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031" status: 200 len: 1253 microversion: 2.1 time: 0.175026 Feb 17 04:39:16.981318 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 204/414] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:16 2021] GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031 => generated 1253 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:16.985543 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ec150852-811a-4b8d-95bd-7b3ca82c0dee tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:16.986050 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ec150852-811a-4b8d-95bd-7b3ca82c0dee tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:16.987626 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ec150852-811a-4b8d-95bd-7b3ca82c0dee tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:16.988582 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ec150852-811a-4b8d-95bd-7b3ca82c0dee tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:17.113921 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-53572db0-96a4-46df-ba81-7e90fe29cd07 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:17.114887 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-53572db0-96a4-46df-ba81-7e90fe29cd07 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:17.123642 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-53572db0-96a4-46df-ba81-7e90fe29cd07 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:17.124370 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-53572db0-96a4-46df-ba81-7e90fe29cd07 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:17.125406 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-53572db0-96a4-46df-ba81-7e90fe29cd07 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:17.126086 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-53572db0-96a4-46df-ba81-7e90fe29cd07 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:17.292572 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-ec150852-811a-4b8d-95bd-7b3ca82c0dee tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:17.303125 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-ec150852-811a-4b8d-95bd-7b3ca82c0dee tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c" status: 200 len: 1568 microversion: 2.1 time: 0.345335 Feb 17 04:39:17.304106 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 211/415] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:16 2021] GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c => generated 1568 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:17.383979 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-53572db0-96a4-46df-ba81-7e90fe29cd07 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:17.394991 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-53572db0-96a4-46df-ba81-7e90fe29cd07 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:17.396568 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-53572db0-96a4-46df-ba81-7e90fe29cd07 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:17.397766 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-53572db0-96a4-46df-ba81-7e90fe29cd07 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1741 microversion: 2.20 time: 0.288898 Feb 17 04:39:17.398335 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 205/416] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:39:17 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1741 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 04:39:17.989447 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-97726039-eb6b-4ff9-a06b-c300d6344d78 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:17.990432 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-97726039-eb6b-4ff9-a06b-c300d6344d78 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] [instance: 9231f663-c4c6-4723-8d42-377d3f6dd031] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:17.999058 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-97726039-eb6b-4ff9-a06b-c300d6344d78 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:17.999856 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-97726039-eb6b-4ff9-a06b-c300d6344d78 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:18.000775 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-97726039-eb6b-4ff9-a06b-c300d6344d78 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:18.001424 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-97726039-eb6b-4ff9-a06b-c300d6344d78 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:18.129249 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-97726039-eb6b-4ff9-a06b-c300d6344d78 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190727a0bed54b52913aa6aa1ff8cea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57600d4d269474ab7d2f3e7ebf528ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:18.138026 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-97726039-eb6b-4ff9-a06b-c300d6344d78 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] 10.222.0.38 "GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031" status: 200 len: 1253 microversion: 2.1 time: 0.153062 Feb 17 04:39:18.138846 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 212/417] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:17 2021] GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031 => generated 1253 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:18.321989 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-34bbb4fc-575b-4e3f-ab31-7d9deab4da27 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:18.322693 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-34bbb4fc-575b-4e3f-ab31-7d9deab4da27 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 68a5c561-c418-4a68-b8b3-1600b638b80c] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:18.330922 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-34bbb4fc-575b-4e3f-ab31-7d9deab4da27 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:18.331379 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-34bbb4fc-575b-4e3f-ab31-7d9deab4da27 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:18.332229 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-34bbb4fc-575b-4e3f-ab31-7d9deab4da27 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:18.332743 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-34bbb4fc-575b-4e3f-ab31-7d9deab4da27 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:18.417518 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-0d6ecfc7-ca44-4fa7-be68-a05eedfd69f2 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:18.418486 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-0d6ecfc7-ca44-4fa7-be68-a05eedfd69f2 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:18.427583 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0d6ecfc7-ca44-4fa7-be68-a05eedfd69f2 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:18.428318 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0d6ecfc7-ca44-4fa7-be68-a05eedfd69f2 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:18.429543 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0d6ecfc7-ca44-4fa7-be68-a05eedfd69f2 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:18.430195 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0d6ecfc7-ca44-4fa7-be68-a05eedfd69f2 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:18.661534 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-34bbb4fc-575b-4e3f-ab31-7d9deab4da27 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:18.671956 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-34bbb4fc-575b-4e3f-ab31-7d9deab4da27 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c" status: 200 len: 1568 microversion: 2.1 time: 0.353987 Feb 17 04:39:18.673107 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 206/418] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:18 2021] GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c => generated 1568 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:18.760389 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-0d6ecfc7-ca44-4fa7-be68-a05eedfd69f2 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:18.771140 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-0d6ecfc7-ca44-4fa7-be68-a05eedfd69f2 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:18.773110 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-0d6ecfc7-ca44-4fa7-be68-a05eedfd69f2 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:18.774654 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-0d6ecfc7-ca44-4fa7-be68-a05eedfd69f2 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1741 microversion: 2.20 time: 0.361207 Feb 17 04:39:18.775645 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 213/419] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:39:18 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1741 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 04:39:19.156481 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-6bc74bb4-6ddd-4b36-b581-459a6328ba72 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:19.158817 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-6bc74bb4-6ddd-4b36-b581-459a6328ba72 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] [instance: 9231f663-c4c6-4723-8d42-377d3f6dd031] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:19.179683 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6bc74bb4-6ddd-4b36-b581-459a6328ba72 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:19.180195 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6bc74bb4-6ddd-4b36-b581-459a6328ba72 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:19.181054 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6bc74bb4-6ddd-4b36-b581-459a6328ba72 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:19.181548 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6bc74bb4-6ddd-4b36-b581-459a6328ba72 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:19.424551 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-6bc74bb4-6ddd-4b36-b581-459a6328ba72 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190727a0bed54b52913aa6aa1ff8cea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57600d4d269474ab7d2f3e7ebf528ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:19.433594 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-6bc74bb4-6ddd-4b36-b581-459a6328ba72 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] 10.222.0.38 "GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031" status: 200 len: 1309 microversion: 2.1 time: 0.281371 Feb 17 04:39:19.436770 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 207/420] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:19 2021] GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031 => generated 1309 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:19.694067 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-f0f9f41a-b707-48ea-9204-37623f322d8f tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:19.694813 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-f0f9f41a-b707-48ea-9204-37623f322d8f tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 68a5c561-c418-4a68-b8b3-1600b638b80c] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:19.712469 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f0f9f41a-b707-48ea-9204-37623f322d8f tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:19.712996 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f0f9f41a-b707-48ea-9204-37623f322d8f tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:19.713855 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f0f9f41a-b707-48ea-9204-37623f322d8f tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:19.714360 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f0f9f41a-b707-48ea-9204-37623f322d8f tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:19.798475 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-e2630603-c628-4522-9809-cecd15399787 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:19.798475 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-e2630603-c628-4522-9809-cecd15399787 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:19.816441 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e2630603-c628-4522-9809-cecd15399787 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:19.817439 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e2630603-c628-4522-9809-cecd15399787 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:19.818798 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e2630603-c628-4522-9809-cecd15399787 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:19.819482 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e2630603-c628-4522-9809-cecd15399787 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:20.583416 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-f0f9f41a-b707-48ea-9204-37623f322d8f tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:20.591292 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-e2630603-c628-4522-9809-cecd15399787 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:20.594591 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-f0f9f41a-b707-48ea-9204-37623f322d8f tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c" status: 200 len: 1568 microversion: 2.1 time: 0.904977 Feb 17 04:39:20.595277 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 214/421] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:19 2021] GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c => generated 1568 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:20.600982 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-afb5bd4b-31aa-45e4-a47a-ddbf5c974405 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:20.601445 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-afb5bd4b-31aa-45e4-a47a-ddbf5c974405 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] [instance: 9231f663-c4c6-4723-8d42-377d3f6dd031] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:20.601708 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-e2630603-c628-4522-9809-cecd15399787 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:20.603337 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-e2630603-c628-4522-9809-cecd15399787 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:20.604729 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-e2630603-c628-4522-9809-cecd15399787 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1723 microversion: 2.20 time: 0.811529 Feb 17 04:39:20.605305 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 208/422] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:39:19 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1723 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:39:20.609464 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-afb5bd4b-31aa-45e4-a47a-ddbf5c974405 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:20.609967 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-afb5bd4b-31aa-45e4-a47a-ddbf5c974405 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:20.610830 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-afb5bd4b-31aa-45e4-a47a-ddbf5c974405 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:20.611390 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-afb5bd4b-31aa-45e4-a47a-ddbf5c974405 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:20.735622 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-afb5bd4b-31aa-45e4-a47a-ddbf5c974405 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190727a0bed54b52913aa6aa1ff8cea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57600d4d269474ab7d2f3e7ebf528ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:20.744717 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-afb5bd4b-31aa-45e4-a47a-ddbf5c974405 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] 10.222.0.38 "GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031" status: 200 len: 1327 microversion: 2.1 time: 0.147727 Feb 17 04:39:20.745310 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 215/423] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:20 2021] GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031 => generated 1327 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:21.614195 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-6e114a6a-35cf-4a4a-af41-7c1b1db59f95 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:21.614885 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-6e114a6a-35cf-4a4a-af41-7c1b1db59f95 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 68a5c561-c418-4a68-b8b3-1600b638b80c] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:21.622819 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6e114a6a-35cf-4a4a-af41-7c1b1db59f95 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:21.623332 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6e114a6a-35cf-4a4a-af41-7c1b1db59f95 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:21.624173 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6e114a6a-35cf-4a4a-af41-7c1b1db59f95 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:21.624669 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-1438271f-2e25-42b0-b173-2cdfe3a345f6 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:21.624798 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6e114a6a-35cf-4a4a-af41-7c1b1db59f95 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:21.625333 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-1438271f-2e25-42b0-b173-2cdfe3a345f6 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:21.633249 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1438271f-2e25-42b0-b173-2cdfe3a345f6 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:21.633753 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1438271f-2e25-42b0-b173-2cdfe3a345f6 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:21.634695 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1438271f-2e25-42b0-b173-2cdfe3a345f6 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:21.635186 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1438271f-2e25-42b0-b173-2cdfe3a345f6 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:21.953374 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-1438271f-2e25-42b0-b173-2cdfe3a345f6 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:21.963470 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-6e114a6a-35cf-4a4a-af41-7c1b1db59f95 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:21.964890 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-1438271f-2e25-42b0-b173-2cdfe3a345f6 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:21.966413 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-1438271f-2e25-42b0-b173-2cdfe3a345f6 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:21.968455 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-1438271f-2e25-42b0-b173-2cdfe3a345f6 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1723 microversion: 2.20 time: 0.347792 Feb 17 04:39:21.969436 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 216/424] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:39:21 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1723 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 04:39:21.974965 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-e1393934-45a2-4bc8-b516-85e00dc58103 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:21.975843 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-e1393934-45a2-4bc8-b516-85e00dc58103 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] [instance: 9231f663-c4c6-4723-8d42-377d3f6dd031] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:21.984558 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e1393934-45a2-4bc8-b516-85e00dc58103 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:21.985277 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e1393934-45a2-4bc8-b516-85e00dc58103 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:21.986358 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e1393934-45a2-4bc8-b516-85e00dc58103 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:21.987106 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e1393934-45a2-4bc8-b516-85e00dc58103 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:21.991891 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-6e114a6a-35cf-4a4a-af41-7c1b1db59f95 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c" status: 200 len: 1568 microversion: 2.1 time: 0.382279 Feb 17 04:39:21.992720 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 209/425] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:21 2021] GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c => generated 1568 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:22.113929 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-e1393934-45a2-4bc8-b516-85e00dc58103 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190727a0bed54b52913aa6aa1ff8cea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57600d4d269474ab7d2f3e7ebf528ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:22.122749 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-e1393934-45a2-4bc8-b516-85e00dc58103 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] 10.222.0.38 "GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031" status: 200 len: 1327 microversion: 2.1 time: 0.152103 Feb 17 04:39:22.123354 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 217/426] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:21 2021] GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031 => generated 1327 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:22.991747 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-f62eaba3-a297-4598-8ee7-b591239e2777 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:22.992458 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-f62eaba3-a297-4598-8ee7-b591239e2777 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:23.000559 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f62eaba3-a297-4598-8ee7-b591239e2777 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:23.001016 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f62eaba3-a297-4598-8ee7-b591239e2777 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:23.002233 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f62eaba3-a297-4598-8ee7-b591239e2777 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:23.002420 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f62eaba3-a297-4598-8ee7-b591239e2777 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:23.011128 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-c72bc7c4-92da-41d8-a7da-7b4ebac4dc95 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:23.011935 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-c72bc7c4-92da-41d8-a7da-7b4ebac4dc95 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 68a5c561-c418-4a68-b8b3-1600b638b80c] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:23.019909 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c72bc7c4-92da-41d8-a7da-7b4ebac4dc95 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:23.020498 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c72bc7c4-92da-41d8-a7da-7b4ebac4dc95 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:23.021412 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c72bc7c4-92da-41d8-a7da-7b4ebac4dc95 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:23.022072 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c72bc7c4-92da-41d8-a7da-7b4ebac4dc95 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:23.903547 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-f62eaba3-a297-4598-8ee7-b591239e2777 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:23.925714 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-f62eaba3-a297-4598-8ee7-b591239e2777 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:23.931032 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-f62eaba3-a297-4598-8ee7-b591239e2777 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:23.932074 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-f62eaba3-a297-4598-8ee7-b591239e2777 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1723 microversion: 2.20 time: 0.945787 Feb 17 04:39:23.937321 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 210/427] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:39:22 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1723 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:39:23.948456 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-32f4c73d-c306-429b-b63a-c88e81313529 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:23.949131 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-32f4c73d-c306-429b-b63a-c88e81313529 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] [instance: 9231f663-c4c6-4723-8d42-377d3f6dd031] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:23.981958 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-32f4c73d-c306-429b-b63a-c88e81313529 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:23.982488 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-32f4c73d-c306-429b-b63a-c88e81313529 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:23.989324 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-32f4c73d-c306-429b-b63a-c88e81313529 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:23.990310 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-32f4c73d-c306-429b-b63a-c88e81313529 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:24.014760 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-c72bc7c4-92da-41d8-a7da-7b4ebac4dc95 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:24.040952 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-c72bc7c4-92da-41d8-a7da-7b4ebac4dc95 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c" status: 200 len: 1568 microversion: 2.1 time: 1.033939 Feb 17 04:39:24.056454 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 218/428] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:23 2021] GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c => generated 1568 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:24.232606 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-32f4c73d-c306-429b-b63a-c88e81313529 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190727a0bed54b52913aa6aa1ff8cea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57600d4d269474ab7d2f3e7ebf528ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:24.243062 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-32f4c73d-c306-429b-b63a-c88e81313529 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] 10.222.0.38 "GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031" status: 200 len: 1315 microversion: 2.1 time: 0.304537 Feb 17 04:39:24.262237 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 211/429] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:23 2021] GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031 => generated 1315 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:24.958762 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-ca582cee-5111-465d-bfba-33a88de145ab tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:24.959835 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-ca582cee-5111-465d-bfba-33a88de145ab tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:24.996718 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ca582cee-5111-465d-bfba-33a88de145ab tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:25.000741 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ca582cee-5111-465d-bfba-33a88de145ab tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:25.003324 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ca582cee-5111-465d-bfba-33a88de145ab tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:25.017927 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ca582cee-5111-465d-bfba-33a88de145ab tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:25.063367 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-9cd06b36-ac45-4642-8a92-4ff6bff51f4b tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:25.064899 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-9cd06b36-ac45-4642-8a92-4ff6bff51f4b tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 68a5c561-c418-4a68-b8b3-1600b638b80c] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:25.076409 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9cd06b36-ac45-4642-8a92-4ff6bff51f4b tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:25.077304 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9cd06b36-ac45-4642-8a92-4ff6bff51f4b tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:25.078336 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9cd06b36-ac45-4642-8a92-4ff6bff51f4b tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:25.079054 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9cd06b36-ac45-4642-8a92-4ff6bff51f4b tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:25.816183 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-ca582cee-5111-465d-bfba-33a88de145ab tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:25.831224 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-ca582cee-5111-465d-bfba-33a88de145ab tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:25.840512 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-9cd06b36-ac45-4642-8a92-4ff6bff51f4b tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:25.848983 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-ca582cee-5111-465d-bfba-33a88de145ab tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:25.851006 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-ca582cee-5111-465d-bfba-33a88de145ab tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1723 microversion: 2.20 time: 0.896827 Feb 17 04:39:25.851872 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 219/430] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:39:24 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1723 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:39:25.852581 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-9cd06b36-ac45-4642-8a92-4ff6bff51f4b tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c" status: 200 len: 1568 microversion: 2.1 time: 0.795022 Feb 17 04:39:25.853178 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 212/431] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:25 2021] GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c => generated 1568 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:25.867257 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-228c4759-d4be-4f72-a6f4-0368d2314c65 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:25.868715 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-228c4759-d4be-4f72-a6f4-0368d2314c65 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] [instance: 9231f663-c4c6-4723-8d42-377d3f6dd031] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:25.886410 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-228c4759-d4be-4f72-a6f4-0368d2314c65 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:25.887139 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-228c4759-d4be-4f72-a6f4-0368d2314c65 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:25.888190 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-228c4759-d4be-4f72-a6f4-0368d2314c65 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:25.888841 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-228c4759-d4be-4f72-a6f4-0368d2314c65 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:26.202281 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-228c4759-d4be-4f72-a6f4-0368d2314c65 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190727a0bed54b52913aa6aa1ff8cea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57600d4d269474ab7d2f3e7ebf528ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:26.225079 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-228c4759-d4be-4f72-a6f4-0368d2314c65 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] 10.222.0.38 "GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031" status: 200 len: 1357 microversion: 2.1 time: 0.371611 Feb 17 04:39:26.225713 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 220/432] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:25 2021] GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031 => generated 1357 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:26.871820 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-7f7eae68-e3d1-462b-bd17-9eef209463c4 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:26.872444 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-17cab12a-1c0a-4122-b68c-3e42df65f203 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:26.872558 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-7f7eae68-e3d1-462b-bd17-9eef209463c4 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 68a5c561-c418-4a68-b8b3-1600b638b80c] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:26.873126 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-17cab12a-1c0a-4122-b68c-3e42df65f203 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:26.881495 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7f7eae68-e3d1-462b-bd17-9eef209463c4 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:26.881672 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-17cab12a-1c0a-4122-b68c-3e42df65f203 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:26.882009 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7f7eae68-e3d1-462b-bd17-9eef209463c4 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:26.882195 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-17cab12a-1c0a-4122-b68c-3e42df65f203 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:26.882928 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7f7eae68-e3d1-462b-bd17-9eef209463c4 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:26.883063 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-17cab12a-1c0a-4122-b68c-3e42df65f203 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:26.883427 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7f7eae68-e3d1-462b-bd17-9eef209463c4 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:26.883530 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-17cab12a-1c0a-4122-b68c-3e42df65f203 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:27.255036 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-7f7eae68-e3d1-462b-bd17-9eef209463c4 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:27.262403 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-17cab12a-1c0a-4122-b68c-3e42df65f203 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:27.265139 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-7f7eae68-e3d1-462b-bd17-9eef209463c4 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c" status: 200 len: 1568 microversion: 2.1 time: 0.397298 Feb 17 04:39:27.266118 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 213/433] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:26 2021] GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c => generated 1568 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:27.273632 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-5e5d590f-4e07-4337-954a-20b652234752 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:27.274758 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-5e5d590f-4e07-4337-954a-20b652234752 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] [instance: 9231f663-c4c6-4723-8d42-377d3f6dd031] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:27.283835 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5e5d590f-4e07-4337-954a-20b652234752 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:27.284346 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5e5d590f-4e07-4337-954a-20b652234752 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:27.285203 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5e5d590f-4e07-4337-954a-20b652234752 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:27.285695 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5e5d590f-4e07-4337-954a-20b652234752 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:27.287644 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-17cab12a-1c0a-4122-b68c-3e42df65f203 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:27.289225 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-17cab12a-1c0a-4122-b68c-3e42df65f203 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:27.290557 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-17cab12a-1c0a-4122-b68c-3e42df65f203 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1723 microversion: 2.20 time: 0.422311 Feb 17 04:39:27.293836 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 221/434] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:39:26 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1723 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 04:39:27.506514 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-5e5d590f-4e07-4337-954a-20b652234752 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190727a0bed54b52913aa6aa1ff8cea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57600d4d269474ab7d2f3e7ebf528ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:27.515618 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-5e5d590f-4e07-4337-954a-20b652234752 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] 10.222.0.38 "GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031" status: 200 len: 1357 microversion: 2.1 time: 0.246864 Feb 17 04:39:27.516219 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 214/435] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:27 2021] GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031 => generated 1357 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:27.714967 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-54fa8243-4290-48e2-9b67-50f2b28d365d tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:27.715561 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-54fa8243-4290-48e2-9b67-50f2b28d365d tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] [instance: d9d6e198-85f5-488e-8317-d498205f37cc] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:27.723520 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-54fa8243-4290-48e2-9b67-50f2b28d365d tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:27.724026 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-54fa8243-4290-48e2-9b67-50f2b28d365d tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:27.724868 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-54fa8243-4290-48e2-9b67-50f2b28d365d tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:27.725359 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-54fa8243-4290-48e2-9b67-50f2b28d365d tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:27.933891 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.objects.instance [None req-54fa8243-4290-48e2-9b67-50f2b28d365d tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lazy-loading 'services' on Instance uuid d9d6e198-85f5-488e-8317-d498205f37cc {{(pid=98080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:39:28.083903 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-54fa8243-4290-48e2-9b67-50f2b28d365d tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] 10.222.0.38 "DELETE /compute/v2.1/servers/d9d6e198-85f5-488e-8317-d498205f37cc/os-volume_attachments/cb48e264-e08c-4448-8b51-db70311de855" status: 202 len: 0 microversion: 2.1 time: 0.372679 Feb 17 04:39:28.084561 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 222/436] 10.222.0.38 () {58 vars in 1406 bytes} [Wed Feb 17 04:39:27 2021] DELETE /compute/v2.1/servers/d9d6e198-85f5-488e-8317-d498205f37cc/os-volume_attachments/cb48e264-e08c-4448-8b51-db70311de855 => generated 0 bytes in 374 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:39:28.284848 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-12cd05f5-930d-4aa7-b19f-5ac0c13b862c tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:28.285516 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-12cd05f5-930d-4aa7-b19f-5ac0c13b862c tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 68a5c561-c418-4a68-b8b3-1600b638b80c] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:28.293468 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-12cd05f5-930d-4aa7-b19f-5ac0c13b862c tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:28.293983 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-12cd05f5-930d-4aa7-b19f-5ac0c13b862c tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:28.294861 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-12cd05f5-930d-4aa7-b19f-5ac0c13b862c tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:28.295357 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-12cd05f5-930d-4aa7-b19f-5ac0c13b862c tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:28.316060 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-e8cab347-1b7b-4bb8-a77b-c98935dd540f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:28.316925 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-e8cab347-1b7b-4bb8-a77b-c98935dd540f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:28.325440 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e8cab347-1b7b-4bb8-a77b-c98935dd540f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:28.325959 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e8cab347-1b7b-4bb8-a77b-c98935dd540f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:28.326855 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e8cab347-1b7b-4bb8-a77b-c98935dd540f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:28.327358 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e8cab347-1b7b-4bb8-a77b-c98935dd540f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:28.646752 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-12cd05f5-930d-4aa7-b19f-5ac0c13b862c tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:28.654391 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-e8cab347-1b7b-4bb8-a77b-c98935dd540f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:28.656215 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-12cd05f5-930d-4aa7-b19f-5ac0c13b862c tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c" status: 200 len: 1568 microversion: 2.1 time: 0.376351 Feb 17 04:39:28.656814 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 215/437] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:28 2021] GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c => generated 1568 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:39:28.663239 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-2af7a725-5a5d-47cf-b321-48043e51819d tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:28.663914 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-2af7a725-5a5d-47cf-b321-48043e51819d tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] [instance: 9231f663-c4c6-4723-8d42-377d3f6dd031] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:28.664821 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-e8cab347-1b7b-4bb8-a77b-c98935dd540f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:28.667098 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-e8cab347-1b7b-4bb8-a77b-c98935dd540f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:28.668315 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-e8cab347-1b7b-4bb8-a77b-c98935dd540f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1723 microversion: 2.20 time: 0.357118 Feb 17 04:39:28.669069 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 223/438] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:39:28 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1723 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:39:28.671816 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2af7a725-5a5d-47cf-b321-48043e51819d tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:28.672531 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2af7a725-5a5d-47cf-b321-48043e51819d tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:28.673169 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2af7a725-5a5d-47cf-b321-48043e51819d tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:28.674315 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2af7a725-5a5d-47cf-b321-48043e51819d tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:28.904120 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-2af7a725-5a5d-47cf-b321-48043e51819d tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190727a0bed54b52913aa6aa1ff8cea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57600d4d269474ab7d2f3e7ebf528ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:28.916028 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-2af7a725-5a5d-47cf-b321-48043e51819d tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] 10.222.0.38 "GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031" status: 200 len: 1357 microversion: 2.1 time: 0.257877 Feb 17 04:39:28.916659 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 216/439] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:28 2021] GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031 => generated 1357 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:29.675826 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-f500634a-5531-4a73-b374-5ab5154c81e1 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:29.676659 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-f500634a-5531-4a73-b374-5ab5154c81e1 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 68a5c561-c418-4a68-b8b3-1600b638b80c] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:29.688132 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f500634a-5531-4a73-b374-5ab5154c81e1 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:29.689496 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-1b6aa0a0-f351-46b4-9c2e-5d1196252829 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:29.689647 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f500634a-5531-4a73-b374-5ab5154c81e1 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:29.690172 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-1b6aa0a0-f351-46b4-9c2e-5d1196252829 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:29.690846 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f500634a-5531-4a73-b374-5ab5154c81e1 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:29.691443 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f500634a-5531-4a73-b374-5ab5154c81e1 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:29.698218 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1b6aa0a0-f351-46b4-9c2e-5d1196252829 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:29.698800 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1b6aa0a0-f351-46b4-9c2e-5d1196252829 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:29.699652 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1b6aa0a0-f351-46b4-9c2e-5d1196252829 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:29.700158 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1b6aa0a0-f351-46b4-9c2e-5d1196252829 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:30.050717 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-1b6aa0a0-f351-46b4-9c2e-5d1196252829 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:30.067283 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-1b6aa0a0-f351-46b4-9c2e-5d1196252829 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:30.068846 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-1b6aa0a0-f351-46b4-9c2e-5d1196252829 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:30.070054 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-1b6aa0a0-f351-46b4-9c2e-5d1196252829 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1723 microversion: 2.20 time: 0.385606 Feb 17 04:39:30.070680 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 217/440] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:39:29 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1723 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:39:30.080544 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-663866c8-5632-49e2-a656-34c8aab9329b tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:30.081248 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-663866c8-5632-49e2-a656-34c8aab9329b tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] [instance: 9231f663-c4c6-4723-8d42-377d3f6dd031] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:30.088804 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-f500634a-5531-4a73-b374-5ab5154c81e1 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:30.097232 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-663866c8-5632-49e2-a656-34c8aab9329b tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:30.097994 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-663866c8-5632-49e2-a656-34c8aab9329b tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:30.098987 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-663866c8-5632-49e2-a656-34c8aab9329b tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:30.099767 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-663866c8-5632-49e2-a656-34c8aab9329b tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:30.102732 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-f500634a-5531-4a73-b374-5ab5154c81e1 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c" status: 200 len: 1568 microversion: 2.1 time: 0.430482 Feb 17 04:39:30.102732 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 224/441] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:29 2021] GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c => generated 1568 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:30.335935 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-663866c8-5632-49e2-a656-34c8aab9329b tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190727a0bed54b52913aa6aa1ff8cea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57600d4d269474ab7d2f3e7ebf528ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:30.355531 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-663866c8-5632-49e2-a656-34c8aab9329b tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] 10.222.0.38 "GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031" status: 200 len: 1357 microversion: 2.1 time: 0.283549 Feb 17 04:39:30.356436 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 218/442] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:30 2021] GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031 => generated 1357 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:31.090233 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-d413ce25-23c7-4429-8659-5e056f94713f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:31.091187 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-d413ce25-23c7-4429-8659-5e056f94713f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:31.100993 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d413ce25-23c7-4429-8659-5e056f94713f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:31.101520 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d413ce25-23c7-4429-8659-5e056f94713f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:31.102586 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d413ce25-23c7-4429-8659-5e056f94713f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:31.103129 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d413ce25-23c7-4429-8659-5e056f94713f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:31.121005 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-98c19a10-5a9e-409c-b667-9d9868030489 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:31.122165 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-98c19a10-5a9e-409c-b667-9d9868030489 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 68a5c561-c418-4a68-b8b3-1600b638b80c] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:31.134960 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-98c19a10-5a9e-409c-b667-9d9868030489 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:31.135992 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-98c19a10-5a9e-409c-b667-9d9868030489 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:31.137115 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-98c19a10-5a9e-409c-b667-9d9868030489 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:31.141625 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-98c19a10-5a9e-409c-b667-9d9868030489 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:31.481140 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-98c19a10-5a9e-409c-b667-9d9868030489 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:31.491680 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-98c19a10-5a9e-409c-b667-9d9868030489 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c" status: 200 len: 1568 microversion: 2.1 time: 0.375701 Feb 17 04:39:31.492538 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 219/443] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:31 2021] GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c => generated 1568 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:39:31.498046 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-1abc7e2b-61a0-40c1-9335-c6bdd2a517f8 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:31.498734 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-1abc7e2b-61a0-40c1-9335-c6bdd2a517f8 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] [instance: 9231f663-c4c6-4723-8d42-377d3f6dd031] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:31.507879 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1abc7e2b-61a0-40c1-9335-c6bdd2a517f8 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:31.508392 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1abc7e2b-61a0-40c1-9335-c6bdd2a517f8 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:31.509245 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1abc7e2b-61a0-40c1-9335-c6bdd2a517f8 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:31.509746 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1abc7e2b-61a0-40c1-9335-c6bdd2a517f8 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:31.581322 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-d413ce25-23c7-4429-8659-5e056f94713f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:31.591788 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-d413ce25-23c7-4429-8659-5e056f94713f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:31.593417 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-d413ce25-23c7-4429-8659-5e056f94713f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:31.594710 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-d413ce25-23c7-4429-8659-5e056f94713f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1723 microversion: 2.20 time: 0.509095 Feb 17 04:39:31.595435 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 225/444] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:39:31 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1723 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:39:31.750865 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-1abc7e2b-61a0-40c1-9335-c6bdd2a517f8 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190727a0bed54b52913aa6aa1ff8cea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57600d4d269474ab7d2f3e7ebf528ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:31.760415 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-1abc7e2b-61a0-40c1-9335-c6bdd2a517f8 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] 10.222.0.38 "GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031" status: 200 len: 1357 microversion: 2.1 time: 0.266120 Feb 17 04:39:31.761013 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 220/445] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:31 2021] GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031 => generated 1357 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:32.510519 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-04a6b6b2-b80a-4005-a69b-2007380f8531 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:32.511248 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-04a6b6b2-b80a-4005-a69b-2007380f8531 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 68a5c561-c418-4a68-b8b3-1600b638b80c] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:32.519651 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-04a6b6b2-b80a-4005-a69b-2007380f8531 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:32.520166 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-04a6b6b2-b80a-4005-a69b-2007380f8531 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:32.521011 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-04a6b6b2-b80a-4005-a69b-2007380f8531 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:32.521508 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-04a6b6b2-b80a-4005-a69b-2007380f8531 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:32.615949 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-a6b8c68c-1425-40f6-a9ef-98857f545758 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:32.615949 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-a6b8c68c-1425-40f6-a9ef-98857f545758 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:32.623769 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a6b8c68c-1425-40f6-a9ef-98857f545758 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:32.624397 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a6b8c68c-1425-40f6-a9ef-98857f545758 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:32.626035 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a6b8c68c-1425-40f6-a9ef-98857f545758 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:32.627405 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a6b8c68c-1425-40f6-a9ef-98857f545758 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:32.805024 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-04a6b6b2-b80a-4005-a69b-2007380f8531 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:32.828539 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-04a6b6b2-b80a-4005-a69b-2007380f8531 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c" status: 200 len: 1568 microversion: 2.1 time: 0.321788 Feb 17 04:39:32.830148 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 226/446] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:32 2021] GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c => generated 1568 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:32.835302 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-c5b7c623-af4d-45c8-8c5f-da0d9058f81d tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:32.838500 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-c5b7c623-af4d-45c8-8c5f-da0d9058f81d tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] [instance: 9231f663-c4c6-4723-8d42-377d3f6dd031] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:32.851347 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c5b7c623-af4d-45c8-8c5f-da0d9058f81d tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:32.851940 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c5b7c623-af4d-45c8-8c5f-da0d9058f81d tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:32.852861 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c5b7c623-af4d-45c8-8c5f-da0d9058f81d tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:32.853382 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c5b7c623-af4d-45c8-8c5f-da0d9058f81d tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:32.894960 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-a6b8c68c-1425-40f6-a9ef-98857f545758 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:32.904754 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-a6b8c68c-1425-40f6-a9ef-98857f545758 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:32.906221 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-a6b8c68c-1425-40f6-a9ef-98857f545758 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:32.907781 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-a6b8c68c-1425-40f6-a9ef-98857f545758 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1723 microversion: 2.20 time: 0.297409 Feb 17 04:39:32.920444 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 221/447] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:39:32 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1723 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:39:33.111594 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-c5b7c623-af4d-45c8-8c5f-da0d9058f81d tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190727a0bed54b52913aa6aa1ff8cea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57600d4d269474ab7d2f3e7ebf528ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:33.120324 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-c5b7c623-af4d-45c8-8c5f-da0d9058f81d tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] 10.222.0.38 "GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031" status: 200 len: 1357 microversion: 2.1 time: 0.288810 Feb 17 04:39:33.120920 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 227/448] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:32 2021] GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031 => generated 1357 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:33.848963 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-a596e152-55ce-4424-80f6-daf3bcc32637 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:33.850014 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-a596e152-55ce-4424-80f6-daf3bcc32637 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 68a5c561-c418-4a68-b8b3-1600b638b80c] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:33.869159 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a596e152-55ce-4424-80f6-daf3bcc32637 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:33.869678 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a596e152-55ce-4424-80f6-daf3bcc32637 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:33.870580 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a596e152-55ce-4424-80f6-daf3bcc32637 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:33.871086 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a596e152-55ce-4424-80f6-daf3bcc32637 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:33.928352 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-59b4c07a-0757-44ec-8e31-b4d1419718ab tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:33.929013 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-59b4c07a-0757-44ec-8e31-b4d1419718ab tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:33.937258 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-59b4c07a-0757-44ec-8e31-b4d1419718ab tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:33.937762 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-59b4c07a-0757-44ec-8e31-b4d1419718ab tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:33.938619 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-59b4c07a-0757-44ec-8e31-b4d1419718ab tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:33.939113 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-59b4c07a-0757-44ec-8e31-b4d1419718ab tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:34.166253 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-a596e152-55ce-4424-80f6-daf3bcc32637 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:34.175962 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-a596e152-55ce-4424-80f6-daf3bcc32637 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c" status: 200 len: 1568 microversion: 2.1 time: 0.331229 Feb 17 04:39:34.176575 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 222/449] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:33 2021] GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c => generated 1568 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:34.181209 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-386f1367-2dfd-4d98-82eb-0784a720e446 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:34.181874 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-386f1367-2dfd-4d98-82eb-0784a720e446 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] [instance: 9231f663-c4c6-4723-8d42-377d3f6dd031] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:34.189853 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-386f1367-2dfd-4d98-82eb-0784a720e446 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:34.190894 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-386f1367-2dfd-4d98-82eb-0784a720e446 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:34.191748 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-386f1367-2dfd-4d98-82eb-0784a720e446 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:34.192240 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-386f1367-2dfd-4d98-82eb-0784a720e446 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:34.216520 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-59b4c07a-0757-44ec-8e31-b4d1419718ab tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:34.233496 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-59b4c07a-0757-44ec-8e31-b4d1419718ab tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:34.240879 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-59b4c07a-0757-44ec-8e31-b4d1419718ab tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:34.242139 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-59b4c07a-0757-44ec-8e31-b4d1419718ab tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1723 microversion: 2.20 time: 0.318487 Feb 17 04:39:34.246299 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 228/450] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:39:33 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1723 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 04:39:34.431199 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-386f1367-2dfd-4d98-82eb-0784a720e446 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190727a0bed54b52913aa6aa1ff8cea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57600d4d269474ab7d2f3e7ebf528ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:34.441489 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-386f1367-2dfd-4d98-82eb-0784a720e446 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] 10.222.0.38 "GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031" status: 200 len: 1357 microversion: 2.1 time: 0.263686 Feb 17 04:39:34.442260 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 223/451] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:34 2021] GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031 => generated 1357 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:35.194899 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-1e4ce17b-508e-4d53-afaa-46cc0c59e8ca tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:35.195569 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-1e4ce17b-508e-4d53-afaa-46cc0c59e8ca tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 68a5c561-c418-4a68-b8b3-1600b638b80c] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:35.203390 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1e4ce17b-508e-4d53-afaa-46cc0c59e8ca tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:35.203901 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1e4ce17b-508e-4d53-afaa-46cc0c59e8ca tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:35.204738 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1e4ce17b-508e-4d53-afaa-46cc0c59e8ca tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:35.205235 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1e4ce17b-508e-4d53-afaa-46cc0c59e8ca tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:35.273100 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-a9daa1d7-2b91-4393-929f-0ee8dd248ef2 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:35.273865 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-a9daa1d7-2b91-4393-929f-0ee8dd248ef2 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:35.281969 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a9daa1d7-2b91-4393-929f-0ee8dd248ef2 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:35.282478 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a9daa1d7-2b91-4393-929f-0ee8dd248ef2 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:35.283353 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a9daa1d7-2b91-4393-929f-0ee8dd248ef2 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:35.283948 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a9daa1d7-2b91-4393-929f-0ee8dd248ef2 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:35.490030 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-1e4ce17b-508e-4d53-afaa-46cc0c59e8ca tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:35.499669 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-1e4ce17b-508e-4d53-afaa-46cc0c59e8ca tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c" status: 200 len: 1568 microversion: 2.1 time: 0.309406 Feb 17 04:39:35.500630 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 229/452] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:35 2021] GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c => generated 1568 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:35.532765 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-7e1215ee-7348-453d-a0ca-88ab90edaa31 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:35.534354 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-7e1215ee-7348-453d-a0ca-88ab90edaa31 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] [instance: 9231f663-c4c6-4723-8d42-377d3f6dd031] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:35.552801 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7e1215ee-7348-453d-a0ca-88ab90edaa31 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:35.553911 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7e1215ee-7348-453d-a0ca-88ab90edaa31 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:35.554883 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7e1215ee-7348-453d-a0ca-88ab90edaa31 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:35.555463 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7e1215ee-7348-453d-a0ca-88ab90edaa31 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:35.588710 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-a9daa1d7-2b91-4393-929f-0ee8dd248ef2 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:35.598949 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-a9daa1d7-2b91-4393-929f-0ee8dd248ef2 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:35.600511 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-a9daa1d7-2b91-4393-929f-0ee8dd248ef2 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:35.601698 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-a9daa1d7-2b91-4393-929f-0ee8dd248ef2 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1723 microversion: 2.20 time: 0.334380 Feb 17 04:39:35.602454 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 224/453] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:39:35 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1723 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:39:35.790418 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-7e1215ee-7348-453d-a0ca-88ab90edaa31 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190727a0bed54b52913aa6aa1ff8cea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57600d4d269474ab7d2f3e7ebf528ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:35.799113 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-7e1215ee-7348-453d-a0ca-88ab90edaa31 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] 10.222.0.38 "GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031" status: 200 len: 1357 microversion: 2.1 time: 0.297245 Feb 17 04:39:35.800411 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 230/454] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:35 2021] GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031 => generated 1357 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:36.537984 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-3cac4503-32b6-42ad-8882-172924d86753 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:36.538712 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-3cac4503-32b6-42ad-8882-172924d86753 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 68a5c561-c418-4a68-b8b3-1600b638b80c] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:36.547337 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-3cac4503-32b6-42ad-8882-172924d86753 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:36.547856 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-3cac4503-32b6-42ad-8882-172924d86753 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:36.548730 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-3cac4503-32b6-42ad-8882-172924d86753 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:36.549504 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-3cac4503-32b6-42ad-8882-172924d86753 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:36.621736 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-804da30b-fdc2-4d49-9ebe-151298b22d7d tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:36.622395 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-804da30b-fdc2-4d49-9ebe-151298b22d7d tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:36.630743 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-804da30b-fdc2-4d49-9ebe-151298b22d7d tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:36.631258 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-804da30b-fdc2-4d49-9ebe-151298b22d7d tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:36.632285 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-804da30b-fdc2-4d49-9ebe-151298b22d7d tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:36.632781 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-804da30b-fdc2-4d49-9ebe-151298b22d7d tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:36.939074 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-3cac4503-32b6-42ad-8882-172924d86753 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:36.970784 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-3cac4503-32b6-42ad-8882-172924d86753 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c" status: 200 len: 1568 microversion: 2.1 time: 0.433206 Feb 17 04:39:36.971497 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 225/455] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:36 2021] GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c => generated 1568 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:36.982294 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-e730893d-5e37-4a6c-880b-43b08ad9dbc8 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:36.983067 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-e730893d-5e37-4a6c-880b-43b08ad9dbc8 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] [instance: 9231f663-c4c6-4723-8d42-377d3f6dd031] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:37.000155 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e730893d-5e37-4a6c-880b-43b08ad9dbc8 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:37.000662 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e730893d-5e37-4a6c-880b-43b08ad9dbc8 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:37.001521 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e730893d-5e37-4a6c-880b-43b08ad9dbc8 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:37.002012 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e730893d-5e37-4a6c-880b-43b08ad9dbc8 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:37.020487 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-804da30b-fdc2-4d49-9ebe-151298b22d7d tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:37.035673 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-804da30b-fdc2-4d49-9ebe-151298b22d7d tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:37.037273 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-804da30b-fdc2-4d49-9ebe-151298b22d7d tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:37.038483 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-804da30b-fdc2-4d49-9ebe-151298b22d7d tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1723 microversion: 2.20 time: 0.420890 Feb 17 04:39:37.042990 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 231/456] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:39:36 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1723 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 04:39:37.252517 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-e730893d-5e37-4a6c-880b-43b08ad9dbc8 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190727a0bed54b52913aa6aa1ff8cea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57600d4d269474ab7d2f3e7ebf528ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:37.261367 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-e730893d-5e37-4a6c-880b-43b08ad9dbc8 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] 10.222.0.38 "GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031" status: 200 len: 1357 microversion: 2.1 time: 0.288768 Feb 17 04:39:37.261980 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 226/457] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:36 2021] GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031 => generated 1357 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:37.989799 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-fa3aa277-c31b-410d-829b-097c4e673246 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:37.990601 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-fa3aa277-c31b-410d-829b-097c4e673246 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 68a5c561-c418-4a68-b8b3-1600b638b80c] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:37.998581 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-fa3aa277-c31b-410d-829b-097c4e673246 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:37.999172 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-fa3aa277-c31b-410d-829b-097c4e673246 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:38.000248 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-fa3aa277-c31b-410d-829b-097c4e673246 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:38.000823 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-fa3aa277-c31b-410d-829b-097c4e673246 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:38.061228 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-4f08c4f6-d8dd-4ce1-970b-f482f1509dfc tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:38.062226 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-4f08c4f6-d8dd-4ce1-970b-f482f1509dfc tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:38.070785 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4f08c4f6-d8dd-4ce1-970b-f482f1509dfc tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:38.071305 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4f08c4f6-d8dd-4ce1-970b-f482f1509dfc tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:38.072140 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4f08c4f6-d8dd-4ce1-970b-f482f1509dfc tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:38.072633 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4f08c4f6-d8dd-4ce1-970b-f482f1509dfc tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:38.704581 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-fa3aa277-c31b-410d-829b-097c4e673246 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:38.717309 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-4f08c4f6-d8dd-4ce1-970b-f482f1509dfc tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:38.717642 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-fa3aa277-c31b-410d-829b-097c4e673246 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c" status: 200 len: 1568 microversion: 2.1 time: 0.732114 Feb 17 04:39:38.719329 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 232/458] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:37 2021] GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c => generated 1568 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:38.728203 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-8dcee6a6-cdff-4670-9aa1-71d8910e4933 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:38.729064 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-8dcee6a6-cdff-4670-9aa1-71d8910e4933 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] [instance: 9231f663-c4c6-4723-8d42-377d3f6dd031] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:38.731509 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-4f08c4f6-d8dd-4ce1-970b-f482f1509dfc tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:38.735382 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-4f08c4f6-d8dd-4ce1-970b-f482f1509dfc tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:38.740221 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8dcee6a6-cdff-4670-9aa1-71d8910e4933 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:38.740791 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8dcee6a6-cdff-4670-9aa1-71d8910e4933 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:38.741259 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-4f08c4f6-d8dd-4ce1-970b-f482f1509dfc tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1723 microversion: 2.20 time: 0.684094 Feb 17 04:39:38.742085 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 227/459] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:39:38 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1723 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 04:39:38.754461 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8dcee6a6-cdff-4670-9aa1-71d8910e4933 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:38.755087 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8dcee6a6-cdff-4670-9aa1-71d8910e4933 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:39.191179 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-8dcee6a6-cdff-4670-9aa1-71d8910e4933 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190727a0bed54b52913aa6aa1ff8cea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57600d4d269474ab7d2f3e7ebf528ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:39.199969 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-8dcee6a6-cdff-4670-9aa1-71d8910e4933 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] 10.222.0.38 "GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031" status: 200 len: 1357 microversion: 2.1 time: 0.479424 Feb 17 04:39:39.200573 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 233/460] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:38 2021] GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031 => generated 1357 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:39.505081 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [req-5d2ae0f6-5e92-4206-9aae-23e472a1f215 req-3bc7eb29-40ea-4c1e-a739-7fa3ff2447a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9231f663-c4c6-4723-8d42-377d3f6dd031", "tag": "8c40a9f8-0504-4483-9e26-48a5210a4191"}]} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:39.507404 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:39:39.507404 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:39:39.517909 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-5d2ae0f6-5e92-4206-9aae-23e472a1f215 req-3bc7eb29-40ea-4c1e-a739-7fa3ff2447a4 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:39.519157 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-5d2ae0f6-5e92-4206-9aae-23e472a1f215 req-3bc7eb29-40ea-4c1e-a739-7fa3ff2447a4 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:39.539509 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.compute.server_external_events [req-5d2ae0f6-5e92-4206-9aae-23e472a1f215 req-3bc7eb29-40ea-4c1e-a739-7fa3ff2447a4 service nova] Creating event network-changed:8c40a9f8-0504-4483-9e26-48a5210a4191 for instance 9231f663-c4c6-4723-8d42-377d3f6dd031 on hv-cinder-76019 Feb 17 04:39:39.544630 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [req-5d2ae0f6-5e92-4206-9aae-23e472a1f215 req-3bc7eb29-40ea-4c1e-a739-7fa3ff2447a4 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044413 Feb 17 04:39:39.545272 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 228/461] 10.222.0.38 () {64 vars in 1308 bytes} [Wed Feb 17 04:39:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:39:39.737501 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-a7f70460-62db-41c3-a186-a3867e48c22b tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:39.738262 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-a7f70460-62db-41c3-a186-a3867e48c22b tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 68a5c561-c418-4a68-b8b3-1600b638b80c] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:39.746026 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a7f70460-62db-41c3-a186-a3867e48c22b tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:39.746528 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a7f70460-62db-41c3-a186-a3867e48c22b tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:39.747453 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a7f70460-62db-41c3-a186-a3867e48c22b tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:39.747942 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a7f70460-62db-41c3-a186-a3867e48c22b tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:39.762715 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-9f19d9e5-553f-48a6-be37-b1bfd4d729a3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:39.763763 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-9f19d9e5-553f-48a6-be37-b1bfd4d729a3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:39.772588 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9f19d9e5-553f-48a6-be37-b1bfd4d729a3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:39.773117 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9f19d9e5-553f-48a6-be37-b1bfd4d729a3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:39.773980 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9f19d9e5-553f-48a6-be37-b1bfd4d729a3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:39.774484 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9f19d9e5-553f-48a6-be37-b1bfd4d729a3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:40.212187 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-9f19d9e5-553f-48a6-be37-b1bfd4d729a3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:40.223302 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-9f19d9e5-553f-48a6-be37-b1bfd4d729a3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:40.225239 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-9f19d9e5-553f-48a6-be37-b1bfd4d729a3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:40.226606 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-9f19d9e5-553f-48a6-be37-b1bfd4d729a3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1723 microversion: 2.20 time: 0.469140 Feb 17 04:39:40.233879 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 229/462] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:39:39 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1723 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:39:40.233879 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-a87e60cb-ba43-4629-b3e9-599290421040 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:40.233879 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-a87e60cb-ba43-4629-b3e9-599290421040 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] [instance: 9231f663-c4c6-4723-8d42-377d3f6dd031] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:40.242284 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a87e60cb-ba43-4629-b3e9-599290421040 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:40.243169 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a87e60cb-ba43-4629-b3e9-599290421040 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:40.244250 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a87e60cb-ba43-4629-b3e9-599290421040 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:40.244866 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a87e60cb-ba43-4629-b3e9-599290421040 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:40.257373 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-a7f70460-62db-41c3-a186-a3867e48c22b tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:40.266989 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-a7f70460-62db-41c3-a186-a3867e48c22b tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c" status: 200 len: 1568 microversion: 2.1 time: 0.534026 Feb 17 04:39:40.267680 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 234/463] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:39 2021] GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c => generated 1568 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:40.627190 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-a87e60cb-ba43-4629-b3e9-599290421040 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190727a0bed54b52913aa6aa1ff8cea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57600d4d269474ab7d2f3e7ebf528ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:40.640953 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-a87e60cb-ba43-4629-b3e9-599290421040 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] 10.222.0.38 "GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031" status: 200 len: 1357 microversion: 2.1 time: 0.412089 Feb 17 04:39:40.642093 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 230/464] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:40 2021] GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031 => generated 1357 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:41.246426 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-0fa57c44-9783-4efa-bf65-a3874206c51f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:41.247130 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-0fa57c44-9783-4efa-bf65-a3874206c51f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:41.255185 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0fa57c44-9783-4efa-bf65-a3874206c51f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:41.255695 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0fa57c44-9783-4efa-bf65-a3874206c51f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:41.256534 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0fa57c44-9783-4efa-bf65-a3874206c51f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:41.257030 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0fa57c44-9783-4efa-bf65-a3874206c51f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:41.286393 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-2353a7d6-3807-4e95-847a-65b77438b166 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:41.287307 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-2353a7d6-3807-4e95-847a-65b77438b166 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 68a5c561-c418-4a68-b8b3-1600b638b80c] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:41.295566 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2353a7d6-3807-4e95-847a-65b77438b166 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:41.296170 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2353a7d6-3807-4e95-847a-65b77438b166 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:41.297164 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2353a7d6-3807-4e95-847a-65b77438b166 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:41.297760 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2353a7d6-3807-4e95-847a-65b77438b166 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:41.838632 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-0fa57c44-9783-4efa-bf65-a3874206c51f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:41.842947 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-2353a7d6-3807-4e95-847a-65b77438b166 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:41.848268 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-0fa57c44-9783-4efa-bf65-a3874206c51f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:41.849829 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-0fa57c44-9783-4efa-bf65-a3874206c51f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:41.851044 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-0fa57c44-9783-4efa-bf65-a3874206c51f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1666 microversion: 2.20 time: 0.608740 Feb 17 04:39:41.851677 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 235/465] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:39:41 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1666 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:39:41.852697 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-2353a7d6-3807-4e95-847a-65b77438b166 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c" status: 200 len: 1568 microversion: 2.1 time: 0.571211 Feb 17 04:39:41.853462 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 231/466] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:41 2021] GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c => generated 1568 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:41.856266 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [req-7a619953-9bbb-4c76-a3fd-cb95acf2f893 req-88232816-6405-4b47-986e-78a92cd1d60c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d9c77fb-c4b1-4b48-a00a-b85af63c8920", "name": "network-vif-unplugged", "status": "completed", "tag": "f8a409c8-c8d0-47e0-b35c-7b5830e57e6e"}]} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:41.858012 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:39:41.858012 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:39:41.867495 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-7a619953-9bbb-4c76-a3fd-cb95acf2f893 req-88232816-6405-4b47-986e-78a92cd1d60c service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:41.867880 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-aa895b59-cfca-4f45-9541-35633af028c2 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:41.868025 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-7a619953-9bbb-4c76-a3fd-cb95acf2f893 req-88232816-6405-4b47-986e-78a92cd1d60c service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:41.868544 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-aa895b59-cfca-4f45-9541-35633af028c2 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] [instance: 9231f663-c4c6-4723-8d42-377d3f6dd031] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:41.876414 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-aa895b59-cfca-4f45-9541-35633af028c2 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:41.876920 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-aa895b59-cfca-4f45-9541-35633af028c2 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:41.878538 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-aa895b59-cfca-4f45-9541-35633af028c2 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:41.879063 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-aa895b59-cfca-4f45-9541-35633af028c2 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:41.885866 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.compute.server_external_events [req-7a619953-9bbb-4c76-a3fd-cb95acf2f893 req-88232816-6405-4b47-986e-78a92cd1d60c service nova] Unable to find a host for instance 8d9c77fb-c4b1-4b48-a00a-b85af63c8920. Dropping event network-vif-unplugged {{(pid=98080) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:141}} Feb 17 04:39:41.886838 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [req-7a619953-9bbb-4c76-a3fd-cb95acf2f893 req-88232816-6405-4b47-986e-78a92cd1d60c service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.034138 Feb 17 04:39:41.887473 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 236/467] 10.222.0.38 () {64 vars in 1308 bytes} [Wed Feb 17 04:39:41 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 35 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Feb 17 04:39:41.892407 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-08cd8aa3-d80c-4a9c-aa0a-847acccadbb4 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d9ec2079-3156-4746-b77b-d25831427498"}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:41.893686 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-08cd8aa3-d80c-4a9c-aa0a-847acccadbb4 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:41.901175 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-08cd8aa3-d80c-4a9c-aa0a-847acccadbb4 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:41.901681 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-08cd8aa3-d80c-4a9c-aa0a-847acccadbb4 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:41.902506 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-08cd8aa3-d80c-4a9c-aa0a-847acccadbb4 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:41.903035 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-08cd8aa3-d80c-4a9c-aa0a-847acccadbb4 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:42.103268 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-aa895b59-cfca-4f45-9541-35633af028c2 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190727a0bed54b52913aa6aa1ff8cea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57600d4d269474ab7d2f3e7ebf528ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:42.112893 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-aa895b59-cfca-4f45-9541-35633af028c2 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] 10.222.0.38 "GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031" status: 200 len: 1357 microversion: 2.1 time: 0.248638 Feb 17 04:39:42.113448 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 232/468] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:41 2021] GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031 => generated 1357 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:42.353377 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-08cd8aa3-d80c-4a9c-aa0a-847acccadbb4 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "POST /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.464705 Feb 17 04:39:42.353947 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 237/469] 10.222.0.38 () {62 vars in 1354 bytes} [Wed Feb 17 04:39:41 2021] POST /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/os-volume_attachments => generated 188 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:39:42.466999 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-868f7585-34d8-42be-bff3-3369bff61d24 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:42.467626 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-868f7585-34d8-42be-bff3-3369bff61d24 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:42.476538 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-868f7585-34d8-42be-bff3-3369bff61d24 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:42.477053 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-868f7585-34d8-42be-bff3-3369bff61d24 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:42.477894 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-868f7585-34d8-42be-bff3-3369bff61d24 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:42.478392 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-868f7585-34d8-42be-bff3-3369bff61d24 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:42.636522 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-868f7585-34d8-42be-bff3-3369bff61d24 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "POST /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/action" status: 202 len: 0 microversion: 2.20 time: 0.174257 Feb 17 04:39:42.637106 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 233/470] 10.222.0.38 () {62 vars in 1309 bytes} [Wed Feb 17 04:39:42 2021] POST /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/action => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 17 04:39:42.646456 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-5b10e51a-f167-4698-8daf-5eda71b4adba tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:42.647161 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-5b10e51a-f167-4698-8daf-5eda71b4adba tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:42.655049 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5b10e51a-f167-4698-8daf-5eda71b4adba tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:42.655563 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5b10e51a-f167-4698-8daf-5eda71b4adba tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:42.656420 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5b10e51a-f167-4698-8daf-5eda71b4adba tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:42.656919 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5b10e51a-f167-4698-8daf-5eda71b4adba tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:42.871307 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-cd84c072-a421-4cbc-9d9d-a5dbcc55369a tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:42.871984 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-cd84c072-a421-4cbc-9d9d-a5dbcc55369a tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 68a5c561-c418-4a68-b8b3-1600b638b80c] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:42.880216 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-5b10e51a-f167-4698-8daf-5eda71b4adba tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:42.881177 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-cd84c072-a421-4cbc-9d9d-a5dbcc55369a tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:42.881931 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-cd84c072-a421-4cbc-9d9d-a5dbcc55369a tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:42.883208 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-cd84c072-a421-4cbc-9d9d-a5dbcc55369a tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:42.883820 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-cd84c072-a421-4cbc-9d9d-a5dbcc55369a tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:42.890201 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-5b10e51a-f167-4698-8daf-5eda71b4adba tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:42.891791 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-5b10e51a-f167-4698-8daf-5eda71b4adba tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:42.893599 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-5b10e51a-f167-4698-8daf-5eda71b4adba tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1752 microversion: 2.20 time: 0.251348 Feb 17 04:39:42.894432 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 238/471] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:39:42 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1752 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:39:43.106729 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-cd84c072-a421-4cbc-9d9d-a5dbcc55369a tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:43.116119 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-cd84c072-a421-4cbc-9d9d-a5dbcc55369a tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c" status: 200 len: 1568 microversion: 2.1 time: 0.249119 Feb 17 04:39:43.116725 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 234/472] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:42 2021] GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c => generated 1568 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:39:43.131371 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-cceb1015-56e2-4902-84b3-94014b72b890 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:43.132148 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-cceb1015-56e2-4902-84b3-94014b72b890 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] [instance: 9231f663-c4c6-4723-8d42-377d3f6dd031] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:43.140121 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-cceb1015-56e2-4902-84b3-94014b72b890 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:43.140577 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-cceb1015-56e2-4902-84b3-94014b72b890 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:43.141491 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-cceb1015-56e2-4902-84b3-94014b72b890 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:43.141896 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-cceb1015-56e2-4902-84b3-94014b72b890 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:43.357713 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-cceb1015-56e2-4902-84b3-94014b72b890 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190727a0bed54b52913aa6aa1ff8cea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57600d4d269474ab7d2f3e7ebf528ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:43.367290 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-cceb1015-56e2-4902-84b3-94014b72b890 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] 10.222.0.38 "GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031" status: 200 len: 1357 microversion: 2.1 time: 0.240632 Feb 17 04:39:43.368157 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 239/473] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:43 2021] GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031 => generated 1357 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:43.913008 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-cd8110a0-1c1c-4511-a39a-54b908dba090 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:43.913611 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-cd8110a0-1c1c-4511-a39a-54b908dba090 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:43.921458 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-cd8110a0-1c1c-4511-a39a-54b908dba090 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:43.921957 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-cd8110a0-1c1c-4511-a39a-54b908dba090 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:43.922815 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-cd8110a0-1c1c-4511-a39a-54b908dba090 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:43.923310 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-cd8110a0-1c1c-4511-a39a-54b908dba090 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:44.133884 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-cd8110a0-1c1c-4511-a39a-54b908dba090 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:44.134279 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-952d7c2b-b334-4d71-b541-be45f466cf6a tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:44.134983 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-952d7c2b-b334-4d71-b541-be45f466cf6a tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 68a5c561-c418-4a68-b8b3-1600b638b80c] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:44.142907 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-952d7c2b-b334-4d71-b541-be45f466cf6a tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:44.143422 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-952d7c2b-b334-4d71-b541-be45f466cf6a tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:44.144177 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-cd8110a0-1c1c-4511-a39a-54b908dba090 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:44.144392 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-952d7c2b-b334-4d71-b541-be45f466cf6a tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:44.145094 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-952d7c2b-b334-4d71-b541-be45f466cf6a tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:44.145738 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-cd8110a0-1c1c-4511-a39a-54b908dba090 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:44.146977 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-cd8110a0-1c1c-4511-a39a-54b908dba090 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1754 microversion: 2.20 time: 0.238584 Feb 17 04:39:44.147550 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 235/474] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:39:43 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1754 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:39:44.372673 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-952d7c2b-b334-4d71-b541-be45f466cf6a tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:44.383391 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-952d7c2b-b334-4d71-b541-be45f466cf6a tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c" status: 200 len: 1568 microversion: 2.1 time: 0.253119 Feb 17 04:39:44.384202 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 240/475] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:44 2021] GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c => generated 1568 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:39:44.385930 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-ae73f721-5a67-4ed4-a30d-4a46774e0462 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:44.386946 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-ae73f721-5a67-4ed4-a30d-4a46774e0462 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] [instance: 9231f663-c4c6-4723-8d42-377d3f6dd031] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:44.396002 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ae73f721-5a67-4ed4-a30d-4a46774e0462 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:44.396513 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ae73f721-5a67-4ed4-a30d-4a46774e0462 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:44.397555 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ae73f721-5a67-4ed4-a30d-4a46774e0462 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:44.398050 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ae73f721-5a67-4ed4-a30d-4a46774e0462 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:44.617067 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-ae73f721-5a67-4ed4-a30d-4a46774e0462 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190727a0bed54b52913aa6aa1ff8cea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57600d4d269474ab7d2f3e7ebf528ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:44.621544 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [req-714ef9f1-cdc7-4c9b-884e-bff254a83954 req-73035108-9630-4d36-9d01-f1745f655c28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9231f663-c4c6-4723-8d42-377d3f6dd031", "name": "network-vif-plugged", "status": "completed", "tag": "8c40a9f8-0504-4483-9e26-48a5210a4191"}]} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:44.623463 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:39:44.623463 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:39:44.627482 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-ae73f721-5a67-4ed4-a30d-4a46774e0462 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] 10.222.0.38 "GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031" status: 200 len: 1357 microversion: 2.1 time: 0.245493 Feb 17 04:39:44.628420 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 236/476] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:44 2021] GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031 => generated 1357 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:44.633586 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-714ef9f1-cdc7-4c9b-884e-bff254a83954 req-73035108-9630-4d36-9d01-f1745f655c28 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:44.634207 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-714ef9f1-cdc7-4c9b-884e-bff254a83954 req-73035108-9630-4d36-9d01-f1745f655c28 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:44.651703 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.compute.server_external_events [req-714ef9f1-cdc7-4c9b-884e-bff254a83954 req-73035108-9630-4d36-9d01-f1745f655c28 service nova] Creating event network-vif-plugged:8c40a9f8-0504-4483-9e26-48a5210a4191 for instance 9231f663-c4c6-4723-8d42-377d3f6dd031 on hv-cinder-76019 Feb 17 04:39:44.657511 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [req-714ef9f1-cdc7-4c9b-884e-bff254a83954 req-73035108-9630-4d36-9d01-f1745f655c28 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040337 Feb 17 04:39:44.658257 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 241/477] 10.222.0.38 () {64 vars in 1308 bytes} [Wed Feb 17 04:39:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:39:45.167103 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-86619c6e-b45d-422a-9a9e-508587c1f4d5 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:45.167797 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-86619c6e-b45d-422a-9a9e-508587c1f4d5 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:45.175879 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-86619c6e-b45d-422a-9a9e-508587c1f4d5 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:45.176386 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-86619c6e-b45d-422a-9a9e-508587c1f4d5 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:45.177215 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-86619c6e-b45d-422a-9a9e-508587c1f4d5 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:45.177704 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-86619c6e-b45d-422a-9a9e-508587c1f4d5 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:45.388602 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-86619c6e-b45d-422a-9a9e-508587c1f4d5 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:45.399466 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-86619c6e-b45d-422a-9a9e-508587c1f4d5 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:45.401035 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-86619c6e-b45d-422a-9a9e-508587c1f4d5 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:45.402232 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-86619c6e-b45d-422a-9a9e-508587c1f4d5 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1754 microversion: 2.20 time: 0.239261 Feb 17 04:39:45.403049 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 237/478] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:39:45 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1754 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:39:45.403161 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-42f3dc4e-e982-4530-9816-d1a9012a20bf tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:45.403896 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-42f3dc4e-e982-4530-9816-d1a9012a20bf tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 68a5c561-c418-4a68-b8b3-1600b638b80c] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:45.412981 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-42f3dc4e-e982-4530-9816-d1a9012a20bf tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:45.413545 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-42f3dc4e-e982-4530-9816-d1a9012a20bf tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:45.414382 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-42f3dc4e-e982-4530-9816-d1a9012a20bf tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:45.414970 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-42f3dc4e-e982-4530-9816-d1a9012a20bf tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:45.638182 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-42f3dc4e-e982-4530-9816-d1a9012a20bf tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:45.645889 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-42fd5767-7e73-42da-9ee9-5bed6be5f4c7 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:45.646601 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-42fd5767-7e73-42da-9ee9-5bed6be5f4c7 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] [instance: 9231f663-c4c6-4723-8d42-377d3f6dd031] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:45.651392 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-42f3dc4e-e982-4530-9816-d1a9012a20bf tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c" status: 200 len: 1568 microversion: 2.1 time: 0.252555 Feb 17 04:39:45.652589 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 242/479] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:45 2021] GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c => generated 1568 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:45.654413 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-42fd5767-7e73-42da-9ee9-5bed6be5f4c7 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:45.654954 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-42fd5767-7e73-42da-9ee9-5bed6be5f4c7 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:45.655806 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-42fd5767-7e73-42da-9ee9-5bed6be5f4c7 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:45.656306 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-42fd5767-7e73-42da-9ee9-5bed6be5f4c7 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:45.872662 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-42fd5767-7e73-42da-9ee9-5bed6be5f4c7 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190727a0bed54b52913aa6aa1ff8cea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57600d4d269474ab7d2f3e7ebf528ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:45.881646 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-42fd5767-7e73-42da-9ee9-5bed6be5f4c7 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] 10.222.0.38 "GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031" status: 200 len: 1357 microversion: 2.1 time: 0.240253 Feb 17 04:39:45.882255 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 238/480] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:45 2021] GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031 => generated 1357 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:46.422336 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-04413089-0f1e-4ef0-86ac-bcb57884b447 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:46.423034 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-04413089-0f1e-4ef0-86ac-bcb57884b447 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:46.431595 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-04413089-0f1e-4ef0-86ac-bcb57884b447 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:46.432103 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-04413089-0f1e-4ef0-86ac-bcb57884b447 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:46.432933 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-04413089-0f1e-4ef0-86ac-bcb57884b447 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:46.433424 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-04413089-0f1e-4ef0-86ac-bcb57884b447 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:46.646167 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-04413089-0f1e-4ef0-86ac-bcb57884b447 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:46.656250 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-04413089-0f1e-4ef0-86ac-bcb57884b447 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:46.657839 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-04413089-0f1e-4ef0-86ac-bcb57884b447 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:46.659101 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-04413089-0f1e-4ef0-86ac-bcb57884b447 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1754 microversion: 2.20 time: 0.240801 Feb 17 04:39:46.660017 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 243/481] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:39:46 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1754 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:39:46.671274 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-0d32b254-b29c-4c7e-a0f0-dc49223dd8c5 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:46.672189 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-0d32b254-b29c-4c7e-a0f0-dc49223dd8c5 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 68a5c561-c418-4a68-b8b3-1600b638b80c] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:46.680716 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0d32b254-b29c-4c7e-a0f0-dc49223dd8c5 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:46.681197 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0d32b254-b29c-4c7e-a0f0-dc49223dd8c5 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:46.682081 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0d32b254-b29c-4c7e-a0f0-dc49223dd8c5 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:46.682590 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0d32b254-b29c-4c7e-a0f0-dc49223dd8c5 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:46.899490 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-023d630b-f1ca-4bb9-8b15-73cf7144f054 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:46.899683 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-0d32b254-b29c-4c7e-a0f0-dc49223dd8c5 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:46.900165 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-023d630b-f1ca-4bb9-8b15-73cf7144f054 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] [instance: 9231f663-c4c6-4723-8d42-377d3f6dd031] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:46.907896 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-023d630b-f1ca-4bb9-8b15-73cf7144f054 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:46.908408 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-023d630b-f1ca-4bb9-8b15-73cf7144f054 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:46.909695 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-0d32b254-b29c-4c7e-a0f0-dc49223dd8c5 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c" status: 200 len: 1568 microversion: 2.1 time: 0.241917 Feb 17 04:39:46.909867 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-023d630b-f1ca-4bb9-8b15-73cf7144f054 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:46.910227 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-023d630b-f1ca-4bb9-8b15-73cf7144f054 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:46.910848 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 239/482] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:46 2021] GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c => generated 1568 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:47.129646 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-023d630b-f1ca-4bb9-8b15-73cf7144f054 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190727a0bed54b52913aa6aa1ff8cea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57600d4d269474ab7d2f3e7ebf528ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:47.138685 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-023d630b-f1ca-4bb9-8b15-73cf7144f054 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] 10.222.0.38 "GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031" status: 200 len: 1546 microversion: 2.1 time: 0.242947 Feb 17 04:39:47.139292 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 244/483] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:46 2021] GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031 => generated 1546 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:39:47.157044 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-72c74fa1-3639-4590-914e-2ee1f430bef8 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:47.157721 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-72c74fa1-3639-4590-914e-2ee1f430bef8 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] [instance: 9231f663-c4c6-4723-8d42-377d3f6dd031] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:47.166344 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-72c74fa1-3639-4590-914e-2ee1f430bef8 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:47.166889 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-72c74fa1-3639-4590-914e-2ee1f430bef8 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:47.167750 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-72c74fa1-3639-4590-914e-2ee1f430bef8 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:47.168251 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-72c74fa1-3639-4590-914e-2ee1f430bef8 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:47.376956 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-72c74fa1-3639-4590-914e-2ee1f430bef8 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190727a0bed54b52913aa6aa1ff8cea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57600d4d269474ab7d2f3e7ebf528ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:47.385960 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-72c74fa1-3639-4590-914e-2ee1f430bef8 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] 10.222.0.38 "GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031" status: 200 len: 1546 microversion: 2.1 time: 0.232784 Feb 17 04:39:47.386630 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 240/484] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:47 2021] GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031 => generated 1546 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:47.403089 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-0955fe5d-38cb-4ade-b89b-ee8b377e3c2f tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:47.406841 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:39:47.406841 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:39:47.407914 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-0955fe5d-38cb-4ade-b89b-ee8b377e3c2f tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '190727a0bed54b52913aa6aa1ff8cea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57600d4d269474ab7d2f3e7ebf528ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:47.408734 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-0955fe5d-38cb-4ade-b89b-ee8b377e3c2f tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Searching by: {'deleted': False, 'project_id': 'e57600d4d269474ab7d2f3e7ebf528ac'} {{(pid=98080) get_all /opt/stack/nova/nova/compute/api.py:2833}} Feb 17 04:39:47.415302 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0955fe5d-38cb-4ade-b89b-ee8b377e3c2f tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:47.415827 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0955fe5d-38cb-4ade-b89b-ee8b377e3c2f tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:47.416702 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0955fe5d-38cb-4ade-b89b-ee8b377e3c2f tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:47.417199 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0955fe5d-38cb-4ade-b89b-ee8b377e3c2f tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:47.514297 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.multi_cell_list [None req-0955fe5d-38cb-4ade-b89b-ee8b377e3c2f tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=98080) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:376}} Feb 17 04:39:47.615939 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-0955fe5d-38cb-4ade-b89b-ee8b377e3c2f tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] 10.222.0.38 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.216858 Feb 17 04:39:47.616588 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 245/485] 10.222.0.38 () {58 vars in 1115 bytes} [Wed Feb 17 04:39:47 2021] GET /compute/v2.1/servers => generated 342 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:39:47.627679 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-db6fd447-9dfc-4aac-87dc-7222b2b5af5d tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:47.628382 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-db6fd447-9dfc-4aac-87dc-7222b2b5af5d tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] [instance: 9231f663-c4c6-4723-8d42-377d3f6dd031] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:47.636206 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-db6fd447-9dfc-4aac-87dc-7222b2b5af5d tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:47.636720 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-db6fd447-9dfc-4aac-87dc-7222b2b5af5d tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:47.637564 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-db6fd447-9dfc-4aac-87dc-7222b2b5af5d tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:47.638065 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-db6fd447-9dfc-4aac-87dc-7222b2b5af5d tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:47.679710 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-31b19096-f0df-402a-b5b4-5d8b4b9a9472 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:47.680385 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-31b19096-f0df-402a-b5b4-5d8b4b9a9472 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:47.688541 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-31b19096-f0df-402a-b5b4-5d8b4b9a9472 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:47.689057 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-31b19096-f0df-402a-b5b4-5d8b4b9a9472 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:47.689904 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-31b19096-f0df-402a-b5b4-5d8b4b9a9472 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:47.690435 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-31b19096-f0df-402a-b5b4-5d8b4b9a9472 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:47.951968 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-db6fd447-9dfc-4aac-87dc-7222b2b5af5d tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190727a0bed54b52913aa6aa1ff8cea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57600d4d269474ab7d2f3e7ebf528ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:47.962070 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-db6fd447-9dfc-4aac-87dc-7222b2b5af5d tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] 10.222.0.38 "GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031" status: 200 len: 1546 microversion: 2.1 time: 0.338356 Feb 17 04:39:47.972313 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-31b19096-f0df-402a-b5b4-5d8b4b9a9472 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:47.972952 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 241/486] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:47 2021] GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031 => generated 1546 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:47.978104 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-b0f7c784-2294-40f9-8f0d-7eed74f49cec tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:47.979100 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-b0f7c784-2294-40f9-8f0d-7eed74f49cec tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 68a5c561-c418-4a68-b8b3-1600b638b80c] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:47.984780 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-31b19096-f0df-402a-b5b4-5d8b4b9a9472 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:47.986421 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-31b19096-f0df-402a-b5b4-5d8b4b9a9472 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:47.987882 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b0f7c784-2294-40f9-8f0d-7eed74f49cec tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:47.988401 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b0f7c784-2294-40f9-8f0d-7eed74f49cec tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:47.988761 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-31b19096-f0df-402a-b5b4-5d8b4b9a9472 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1754 microversion: 2.20 time: 0.313639 Feb 17 04:39:47.989262 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b0f7c784-2294-40f9-8f0d-7eed74f49cec tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:47.989374 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 246/487] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:39:47 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1754 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 04:39:47.989763 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b0f7c784-2294-40f9-8f0d-7eed74f49cec tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:48.209890 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-b0f7c784-2294-40f9-8f0d-7eed74f49cec tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:48.219692 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-b0f7c784-2294-40f9-8f0d-7eed74f49cec tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c" status: 200 len: 1568 microversion: 2.1 time: 0.245365 Feb 17 04:39:48.220498 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 242/488] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:47 2021] GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c => generated 1568 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:49.008578 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-6b2c1285-2c23-4529-bf3a-ef12c2aeef20 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:49.009242 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-6b2c1285-2c23-4529-bf3a-ef12c2aeef20 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:49.017471 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6b2c1285-2c23-4529-bf3a-ef12c2aeef20 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:49.017979 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6b2c1285-2c23-4529-bf3a-ef12c2aeef20 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:49.019208 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6b2c1285-2c23-4529-bf3a-ef12c2aeef20 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:49.019709 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6b2c1285-2c23-4529-bf3a-ef12c2aeef20 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:49.231984 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-6b2c1285-2c23-4529-bf3a-ef12c2aeef20 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:49.237992 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-3f05fce4-558f-4605-bb92-a2bc7cb87dc2 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:49.238861 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-3f05fce4-558f-4605-bb92-a2bc7cb87dc2 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 68a5c561-c418-4a68-b8b3-1600b638b80c] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:49.242454 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-6b2c1285-2c23-4529-bf3a-ef12c2aeef20 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:49.244063 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-6b2c1285-2c23-4529-bf3a-ef12c2aeef20 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:49.245304 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-6b2c1285-2c23-4529-bf3a-ef12c2aeef20 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1754 microversion: 2.20 time: 0.240738 Feb 17 04:39:49.245820 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 247/489] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:39:49 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1754 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:39:49.246651 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-3f05fce4-558f-4605-bb92-a2bc7cb87dc2 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:49.247165 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-3f05fce4-558f-4605-bb92-a2bc7cb87dc2 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:49.248000 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-3f05fce4-558f-4605-bb92-a2bc7cb87dc2 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:49.248497 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-3f05fce4-558f-4605-bb92-a2bc7cb87dc2 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:49.460829 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-3f05fce4-558f-4605-bb92-a2bc7cb87dc2 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:49.470924 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-3f05fce4-558f-4605-bb92-a2bc7cb87dc2 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c" status: 200 len: 1568 microversion: 2.1 time: 0.237513 Feb 17 04:39:49.471527 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 243/490] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:49 2021] GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c => generated 1568 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:50.265494 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-2b831f41-a15d-4c22-99b9-a22e58f90e82 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:50.266158 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-2b831f41-a15d-4c22-99b9-a22e58f90e82 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:50.274747 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2b831f41-a15d-4c22-99b9-a22e58f90e82 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:50.275264 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2b831f41-a15d-4c22-99b9-a22e58f90e82 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:50.276106 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2b831f41-a15d-4c22-99b9-a22e58f90e82 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:50.276602 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2b831f41-a15d-4c22-99b9-a22e58f90e82 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:50.489239 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-94f4cd1c-dc79-4e17-8291-cecbdc650a82 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:50.489908 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-94f4cd1c-dc79-4e17-8291-cecbdc650a82 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 68a5c561-c418-4a68-b8b3-1600b638b80c] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:50.497840 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-94f4cd1c-dc79-4e17-8291-cecbdc650a82 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:50.498627 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-94f4cd1c-dc79-4e17-8291-cecbdc650a82 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:50.500299 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-94f4cd1c-dc79-4e17-8291-cecbdc650a82 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:50.501043 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-94f4cd1c-dc79-4e17-8291-cecbdc650a82 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:50.503832 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-2b831f41-a15d-4c22-99b9-a22e58f90e82 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:50.528088 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-2b831f41-a15d-4c22-99b9-a22e58f90e82 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:50.529668 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-2b831f41-a15d-4c22-99b9-a22e58f90e82 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:50.530897 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-2b831f41-a15d-4c22-99b9-a22e58f90e82 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1754 microversion: 2.20 time: 0.269466 Feb 17 04:39:50.531488 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 248/491] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:39:50 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1754 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:39:50.717060 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-94f4cd1c-dc79-4e17-8291-cecbdc650a82 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:50.726918 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-94f4cd1c-dc79-4e17-8291-cecbdc650a82 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c" status: 200 len: 1568 microversion: 2.1 time: 0.241550 Feb 17 04:39:50.727528 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 244/492] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:50 2021] GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c => generated 1568 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:51.551589 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-b4dd8f70-cc86-4ff8-99e7-a9b015825911 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:51.552194 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-b4dd8f70-cc86-4ff8-99e7-a9b015825911 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:51.560315 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b4dd8f70-cc86-4ff8-99e7-a9b015825911 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:51.560820 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b4dd8f70-cc86-4ff8-99e7-a9b015825911 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:51.561697 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b4dd8f70-cc86-4ff8-99e7-a9b015825911 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:51.562187 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b4dd8f70-cc86-4ff8-99e7-a9b015825911 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:51.745069 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-777dd4a9-0ba1-479b-954d-27f1c7408f7b tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:51.745741 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-777dd4a9-0ba1-479b-954d-27f1c7408f7b tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 68a5c561-c418-4a68-b8b3-1600b638b80c] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:51.754520 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-777dd4a9-0ba1-479b-954d-27f1c7408f7b tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:51.755046 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-777dd4a9-0ba1-479b-954d-27f1c7408f7b tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:51.756091 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-777dd4a9-0ba1-479b-954d-27f1c7408f7b tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:51.756556 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-777dd4a9-0ba1-479b-954d-27f1c7408f7b tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:51.779089 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-b4dd8f70-cc86-4ff8-99e7-a9b015825911 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:51.790895 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-b4dd8f70-cc86-4ff8-99e7-a9b015825911 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:51.792620 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-b4dd8f70-cc86-4ff8-99e7-a9b015825911 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:51.793939 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-b4dd8f70-cc86-4ff8-99e7-a9b015825911 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1754 microversion: 2.20 time: 0.247103 Feb 17 04:39:51.795409 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 249/493] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:39:51 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1754 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:39:51.979697 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-777dd4a9-0ba1-479b-954d-27f1c7408f7b tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:51.989812 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-777dd4a9-0ba1-479b-954d-27f1c7408f7b tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c" status: 200 len: 1568 microversion: 2.1 time: 0.248818 Feb 17 04:39:51.990619 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 245/494] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:51 2021] GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c => generated 1568 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:52.025494 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-18ad699c-b3f7-4afe-8578-cfd3758a8293 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ee70abce-9c43-4e9b-9de1-472ce008042d"}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:39:52.026784 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-18ad699c-b3f7-4afe-8578-cfd3758a8293 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] [instance: 9231f663-c4c6-4723-8d42-377d3f6dd031] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:52.035355 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-18ad699c-b3f7-4afe-8578-cfd3758a8293 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:52.035871 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-18ad699c-b3f7-4afe-8578-cfd3758a8293 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:52.036714 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-18ad699c-b3f7-4afe-8578-cfd3758a8293 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:52.037223 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-18ad699c-b3f7-4afe-8578-cfd3758a8293 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:52.477516 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-18ad699c-b3f7-4afe-8578-cfd3758a8293 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] 10.222.0.38 "POST /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.456087 Feb 17 04:39:52.478343 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 250/495] 10.222.0.38 () {60 vars in 1313 bytes} [Wed Feb 17 04:39:52 2021] POST /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031/os-volume_attachments => generated 194 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:39:52.561443 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-6c3e6367-9b31-4100-b03f-337a09cb689c tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:52.563028 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-6c3e6367-9b31-4100-b03f-337a09cb689c tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: b5217ba8-1c7d-4811-bc6f-daeedd5d8d02] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:52.572599 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6c3e6367-9b31-4100-b03f-337a09cb689c tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:52.572974 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6c3e6367-9b31-4100-b03f-337a09cb689c tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:52.573986 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6c3e6367-9b31-4100-b03f-337a09cb689c tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:52.574753 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6c3e6367-9b31-4100-b03f-337a09cb689c tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:52.755373 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.objects.instance [None req-6c3e6367-9b31-4100-b03f-337a09cb689c tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lazy-loading 'services' on Instance uuid b5217ba8-1c7d-4811-bc6f-daeedd5d8d02 {{(pid=98081) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:39:52.814602 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-997769b3-acc8-45fc-8d43-2861b0ffb6f3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:52.816069 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-997769b3-acc8-45fc-8d43-2861b0ffb6f3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:52.824994 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-997769b3-acc8-45fc-8d43-2861b0ffb6f3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:52.825508 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-997769b3-acc8-45fc-8d43-2861b0ffb6f3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:52.826356 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-997769b3-acc8-45fc-8d43-2861b0ffb6f3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:52.826894 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-997769b3-acc8-45fc-8d43-2861b0ffb6f3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:52.896269 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-6c3e6367-9b31-4100-b03f-337a09cb689c tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "DELETE /compute/v2.1/servers/b5217ba8-1c7d-4811-bc6f-daeedd5d8d02/os-volume_attachments/4d0c2b76-d6e5-4765-bba2-318e7aad424c" status: 202 len: 0 microversion: 2.1 time: 0.339000 Feb 17 04:39:52.896917 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 246/496] 10.222.0.38 () {58 vars in 1406 bytes} [Wed Feb 17 04:39:52 2021] DELETE /compute/v2.1/servers/b5217ba8-1c7d-4811-bc6f-daeedd5d8d02/os-volume_attachments/4d0c2b76-d6e5-4765-bba2-318e7aad424c => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:39:53.009545 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-fdb06aa9-7057-4344-a8cf-f158cbcc2dcf tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:53.010315 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-fdb06aa9-7057-4344-a8cf-f158cbcc2dcf tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 68a5c561-c418-4a68-b8b3-1600b638b80c] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:53.027794 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-fdb06aa9-7057-4344-a8cf-f158cbcc2dcf tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:53.028308 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-fdb06aa9-7057-4344-a8cf-f158cbcc2dcf tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:53.029178 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-fdb06aa9-7057-4344-a8cf-f158cbcc2dcf tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:53.029675 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-fdb06aa9-7057-4344-a8cf-f158cbcc2dcf tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:53.052942 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-997769b3-acc8-45fc-8d43-2861b0ffb6f3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:53.064839 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-997769b3-acc8-45fc-8d43-2861b0ffb6f3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:53.066737 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-997769b3-acc8-45fc-8d43-2861b0ffb6f3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:53.067929 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-997769b3-acc8-45fc-8d43-2861b0ffb6f3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1754 microversion: 2.20 time: 0.257968 Feb 17 04:39:53.068661 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 251/497] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:39:52 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1754 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 04:39:53.259105 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-fdb06aa9-7057-4344-a8cf-f158cbcc2dcf tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:53.268499 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-fdb06aa9-7057-4344-a8cf-f158cbcc2dcf tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c" status: 200 len: 1568 microversion: 2.1 time: 0.263314 Feb 17 04:39:53.269108 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 247/498] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:53 2021] GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c => generated 1568 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:54.087881 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-14f12b61-bdb7-4566-ad0e-3a4340f51efa tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:54.088554 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-14f12b61-bdb7-4566-ad0e-3a4340f51efa tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:54.096688 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-14f12b61-bdb7-4566-ad0e-3a4340f51efa tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:54.097273 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-14f12b61-bdb7-4566-ad0e-3a4340f51efa tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:54.098133 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-14f12b61-bdb7-4566-ad0e-3a4340f51efa tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:54.098657 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-14f12b61-bdb7-4566-ad0e-3a4340f51efa tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:54.285461 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-02cfe86d-9141-4bcc-b0d7-1f9326f5a916 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:54.286145 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-02cfe86d-9141-4bcc-b0d7-1f9326f5a916 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 68a5c561-c418-4a68-b8b3-1600b638b80c] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:54.294130 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-02cfe86d-9141-4bcc-b0d7-1f9326f5a916 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:54.294675 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-02cfe86d-9141-4bcc-b0d7-1f9326f5a916 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:54.295542 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-02cfe86d-9141-4bcc-b0d7-1f9326f5a916 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:54.296046 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-02cfe86d-9141-4bcc-b0d7-1f9326f5a916 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:54.316931 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-14f12b61-bdb7-4566-ad0e-3a4340f51efa tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:54.327882 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-14f12b61-bdb7-4566-ad0e-3a4340f51efa tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:54.329477 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-14f12b61-bdb7-4566-ad0e-3a4340f51efa tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:54.330795 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-14f12b61-bdb7-4566-ad0e-3a4340f51efa tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1754 microversion: 2.20 time: 0.246775 Feb 17 04:39:54.331453 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 252/499] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:39:54 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1754 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:39:54.644356 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-02cfe86d-9141-4bcc-b0d7-1f9326f5a916 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:54.653621 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-02cfe86d-9141-4bcc-b0d7-1f9326f5a916 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c" status: 200 len: 1568 microversion: 2.1 time: 0.372204 Feb 17 04:39:54.654228 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 248/500] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:54 2021] GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c => generated 1568 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:55.352504 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-8a891e6e-f21e-41fb-a799-60a1f9d0226d tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:55.353192 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-8a891e6e-f21e-41fb-a799-60a1f9d0226d tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:55.361077 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8a891e6e-f21e-41fb-a799-60a1f9d0226d tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:55.361596 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8a891e6e-f21e-41fb-a799-60a1f9d0226d tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:55.362484 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8a891e6e-f21e-41fb-a799-60a1f9d0226d tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:55.362985 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8a891e6e-f21e-41fb-a799-60a1f9d0226d tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:55.573548 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-8a891e6e-f21e-41fb-a799-60a1f9d0226d tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:55.583984 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-8a891e6e-f21e-41fb-a799-60a1f9d0226d tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:55.585541 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-8a891e6e-f21e-41fb-a799-60a1f9d0226d tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:55.586736 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-8a891e6e-f21e-41fb-a799-60a1f9d0226d tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1754 microversion: 2.20 time: 0.239120 Feb 17 04:39:55.587324 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 253/501] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:39:55 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1754 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:39:55.672074 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-c5ae23e8-c3a4-47a8-94c8-33c0be8a3ba9 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:55.672743 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-c5ae23e8-c3a4-47a8-94c8-33c0be8a3ba9 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 68a5c561-c418-4a68-b8b3-1600b638b80c] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:55.680800 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c5ae23e8-c3a4-47a8-94c8-33c0be8a3ba9 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:55.681309 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c5ae23e8-c3a4-47a8-94c8-33c0be8a3ba9 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:55.682158 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c5ae23e8-c3a4-47a8-94c8-33c0be8a3ba9 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:55.682685 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c5ae23e8-c3a4-47a8-94c8-33c0be8a3ba9 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:55.995729 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-c5ae23e8-c3a4-47a8-94c8-33c0be8a3ba9 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:56.007338 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-c5ae23e8-c3a4-47a8-94c8-33c0be8a3ba9 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c" status: 200 len: 1568 microversion: 2.1 time: 0.339229 Feb 17 04:39:56.007958 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 249/502] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:55 2021] GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c => generated 1568 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:56.607229 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-989e2c9d-fa2a-4a32-a605-b4fb789a645a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:56.607896 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-989e2c9d-fa2a-4a32-a605-b4fb789a645a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:56.619123 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-989e2c9d-fa2a-4a32-a605-b4fb789a645a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:56.619719 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-989e2c9d-fa2a-4a32-a605-b4fb789a645a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:56.620445 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-989e2c9d-fa2a-4a32-a605-b4fb789a645a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:56.620982 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-989e2c9d-fa2a-4a32-a605-b4fb789a645a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:56.896261 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-989e2c9d-fa2a-4a32-a605-b4fb789a645a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:56.906228 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-989e2c9d-fa2a-4a32-a605-b4fb789a645a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:56.908016 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-989e2c9d-fa2a-4a32-a605-b4fb789a645a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:56.909954 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-989e2c9d-fa2a-4a32-a605-b4fb789a645a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1754 microversion: 2.20 time: 0.306071 Feb 17 04:39:56.910760 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 254/503] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:39:56 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1754 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:39:57.011034 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 17 04:39:57.011415 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: Wed Feb 17 04:39:57 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 17 04:39:57.031219 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-d187e515-8e0b-494b-8c2c-7bb4dd842cc0 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:57.031904 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-d187e515-8e0b-494b-8c2c-7bb4dd842cc0 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 68a5c561-c418-4a68-b8b3-1600b638b80c] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:57.044256 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d187e515-8e0b-494b-8c2c-7bb4dd842cc0 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:57.044769 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d187e515-8e0b-494b-8c2c-7bb4dd842cc0 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:57.045625 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d187e515-8e0b-494b-8c2c-7bb4dd842cc0 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:57.046118 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d187e515-8e0b-494b-8c2c-7bb4dd842cc0 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:57.275132 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-d187e515-8e0b-494b-8c2c-7bb4dd842cc0 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:57.284581 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-d187e515-8e0b-494b-8c2c-7bb4dd842cc0 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c" status: 200 len: 1568 microversion: 2.1 time: 0.262436 Feb 17 04:39:57.285176 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 250/504] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:57 2021] GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c => generated 1568 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:57.930408 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-12603792-7b62-4154-9829-e4e4d86a9a11 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:57.931140 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-12603792-7b62-4154-9829-e4e4d86a9a11 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:57.940098 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-12603792-7b62-4154-9829-e4e4d86a9a11 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:57.941111 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-12603792-7b62-4154-9829-e4e4d86a9a11 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:57.942039 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-12603792-7b62-4154-9829-e4e4d86a9a11 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:57.942542 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-12603792-7b62-4154-9829-e4e4d86a9a11 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:58.170100 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-12603792-7b62-4154-9829-e4e4d86a9a11 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:58.181188 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-12603792-7b62-4154-9829-e4e4d86a9a11 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:58.183121 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-12603792-7b62-4154-9829-e4e4d86a9a11 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:58.184506 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-12603792-7b62-4154-9829-e4e4d86a9a11 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1754 microversion: 2.20 time: 0.258546 Feb 17 04:39:58.185084 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 255/505] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:39:57 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1754 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:39:58.302510 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-564ceb70-4690-47d3-a02f-552d99e21f33 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:58.303279 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-564ceb70-4690-47d3-a02f-552d99e21f33 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 68a5c561-c418-4a68-b8b3-1600b638b80c] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:58.311373 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-564ceb70-4690-47d3-a02f-552d99e21f33 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:58.311892 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-564ceb70-4690-47d3-a02f-552d99e21f33 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:58.312736 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-564ceb70-4690-47d3-a02f-552d99e21f33 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:58.313241 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-564ceb70-4690-47d3-a02f-552d99e21f33 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:58.524461 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-564ceb70-4690-47d3-a02f-552d99e21f33 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:58.533932 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-564ceb70-4690-47d3-a02f-552d99e21f33 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c" status: 200 len: 1568 microversion: 2.1 time: 0.235391 Feb 17 04:39:58.535306 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 251/506] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:58 2021] GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c => generated 1568 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:39:59.204236 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-98a7e92f-d5d5-4c0a-bff0-ea1fdc311aef tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:59.204906 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-98a7e92f-d5d5-4c0a-bff0-ea1fdc311aef tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:59.213092 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-98a7e92f-d5d5-4c0a-bff0-ea1fdc311aef tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:59.213602 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-98a7e92f-d5d5-4c0a-bff0-ea1fdc311aef tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:59.214440 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-98a7e92f-d5d5-4c0a-bff0-ea1fdc311aef tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:59.214964 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-98a7e92f-d5d5-4c0a-bff0-ea1fdc311aef tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:59.434987 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-98a7e92f-d5d5-4c0a-bff0-ea1fdc311aef tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:59.445476 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-98a7e92f-d5d5-4c0a-bff0-ea1fdc311aef tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:59.447078 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-98a7e92f-d5d5-4c0a-bff0-ea1fdc311aef tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:59.448268 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-98a7e92f-d5d5-4c0a-bff0-ea1fdc311aef tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1754 microversion: 2.20 time: 0.248017 Feb 17 04:39:59.448865 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 256/507] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:39:59 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1754 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:39:59.553355 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-b8c9378c-e850-4196-85f8-a0c165bf0cc4 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:39:59.554083 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-b8c9378c-e850-4196-85f8-a0c165bf0cc4 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 68a5c561-c418-4a68-b8b3-1600b638b80c] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:39:59.563154 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b8c9378c-e850-4196-85f8-a0c165bf0cc4 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:59.563800 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b8c9378c-e850-4196-85f8-a0c165bf0cc4 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:59.564782 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b8c9378c-e850-4196-85f8-a0c165bf0cc4 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:39:59.565278 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b8c9378c-e850-4196-85f8-a0c165bf0cc4 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:39:59.776685 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-b8c9378c-e850-4196-85f8-a0c165bf0cc4 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:39:59.786686 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-b8c9378c-e850-4196-85f8-a0c165bf0cc4 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c" status: 200 len: 1568 microversion: 2.1 time: 0.237679 Feb 17 04:39:59.787228 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 252/508] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:39:59 2021] GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c => generated 1568 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:40:00.468902 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-24c5a193-9984-43ef-82ca-45ecc5dd0e2d tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:00.469659 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-24c5a193-9984-43ef-82ca-45ecc5dd0e2d tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:00.477897 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-24c5a193-9984-43ef-82ca-45ecc5dd0e2d tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:00.478413 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-24c5a193-9984-43ef-82ca-45ecc5dd0e2d tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:00.479305 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-24c5a193-9984-43ef-82ca-45ecc5dd0e2d tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:00.479808 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-24c5a193-9984-43ef-82ca-45ecc5dd0e2d tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:00.698462 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-24c5a193-9984-43ef-82ca-45ecc5dd0e2d tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:00.708605 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-24c5a193-9984-43ef-82ca-45ecc5dd0e2d tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:00.710175 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-24c5a193-9984-43ef-82ca-45ecc5dd0e2d tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:00.711391 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-24c5a193-9984-43ef-82ca-45ecc5dd0e2d tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1754 microversion: 2.20 time: 0.247024 Feb 17 04:40:00.711984 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 257/509] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:40:00 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1754 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:40:00.805047 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-ff25f14d-dfa2-4ddf-aa1d-baede91d694b tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:00.805700 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-ff25f14d-dfa2-4ddf-aa1d-baede91d694b tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 68a5c561-c418-4a68-b8b3-1600b638b80c] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:00.813748 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ff25f14d-dfa2-4ddf-aa1d-baede91d694b tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:00.814248 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ff25f14d-dfa2-4ddf-aa1d-baede91d694b tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:00.815107 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ff25f14d-dfa2-4ddf-aa1d-baede91d694b tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:00.815630 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ff25f14d-dfa2-4ddf-aa1d-baede91d694b tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:01.029119 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-ff25f14d-dfa2-4ddf-aa1d-baede91d694b tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:01.038989 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-ff25f14d-dfa2-4ddf-aa1d-baede91d694b tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c" status: 200 len: 1568 microversion: 2.1 time: 0.237942 Feb 17 04:40:01.039586 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 253/510] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:00 2021] GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c => generated 1568 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:40:01.731231 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-6ed6b5cb-c943-4b58-aea5-3408c250df44 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:01.731899 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-6ed6b5cb-c943-4b58-aea5-3408c250df44 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:01.740538 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6ed6b5cb-c943-4b58-aea5-3408c250df44 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:01.741046 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6ed6b5cb-c943-4b58-aea5-3408c250df44 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:01.741886 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6ed6b5cb-c943-4b58-aea5-3408c250df44 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:01.742385 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6ed6b5cb-c943-4b58-aea5-3408c250df44 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:01.956067 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-6ed6b5cb-c943-4b58-aea5-3408c250df44 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:01.966197 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-6ed6b5cb-c943-4b58-aea5-3408c250df44 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:01.967793 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-6ed6b5cb-c943-4b58-aea5-3408c250df44 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:01.968979 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-6ed6b5cb-c943-4b58-aea5-3408c250df44 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1754 microversion: 2.20 time: 0.241792 Feb 17 04:40:01.969573 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 258/511] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:40:01 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1754 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:40:02.057102 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-2ea00913-5bb2-486d-9391-2f2a9679780e tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:02.057768 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-2ea00913-5bb2-486d-9391-2f2a9679780e tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 68a5c561-c418-4a68-b8b3-1600b638b80c] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:02.066547 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2ea00913-5bb2-486d-9391-2f2a9679780e tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:02.067093 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2ea00913-5bb2-486d-9391-2f2a9679780e tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:02.067925 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2ea00913-5bb2-486d-9391-2f2a9679780e tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:02.068421 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2ea00913-5bb2-486d-9391-2f2a9679780e tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:02.277978 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-2ea00913-5bb2-486d-9391-2f2a9679780e tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:02.287909 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-2ea00913-5bb2-486d-9391-2f2a9679780e tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c" status: 200 len: 1568 microversion: 2.1 time: 0.234817 Feb 17 04:40:02.288505 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 254/512] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:02 2021] GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c => generated 1568 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:40:02.989257 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-5cbccfa8-68e9-49fc-ba49-28cf6694b8e7 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:02.990029 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-5cbccfa8-68e9-49fc-ba49-28cf6694b8e7 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:02.998033 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5cbccfa8-68e9-49fc-ba49-28cf6694b8e7 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:02.998651 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5cbccfa8-68e9-49fc-ba49-28cf6694b8e7 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:02.999505 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5cbccfa8-68e9-49fc-ba49-28cf6694b8e7 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:03.000110 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5cbccfa8-68e9-49fc-ba49-28cf6694b8e7 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:03.210646 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-5cbccfa8-68e9-49fc-ba49-28cf6694b8e7 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:03.220375 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-5cbccfa8-68e9-49fc-ba49-28cf6694b8e7 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:03.222452 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-5cbccfa8-68e9-49fc-ba49-28cf6694b8e7 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:03.223646 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-5cbccfa8-68e9-49fc-ba49-28cf6694b8e7 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1754 microversion: 2.20 time: 0.239122 Feb 17 04:40:03.224232 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 259/513] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:40:02 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1754 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:40:03.306644 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-cb7ef492-02f9-4b3c-9f84-63c181a6272d tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:03.307323 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-cb7ef492-02f9-4b3c-9f84-63c181a6272d tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 68a5c561-c418-4a68-b8b3-1600b638b80c] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:03.315413 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-cb7ef492-02f9-4b3c-9f84-63c181a6272d tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:03.316093 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-cb7ef492-02f9-4b3c-9f84-63c181a6272d tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:03.316930 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-cb7ef492-02f9-4b3c-9f84-63c181a6272d tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:03.317426 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-cb7ef492-02f9-4b3c-9f84-63c181a6272d tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:03.734213 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-cb7ef492-02f9-4b3c-9f84-63c181a6272d tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:03.743716 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-cb7ef492-02f9-4b3c-9f84-63c181a6272d tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c" status: 200 len: 1568 microversion: 2.1 time: 0.441135 Feb 17 04:40:03.744305 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 255/514] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:03 2021] GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c => generated 1568 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:40:04.242662 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-c795ce78-4252-489f-8de6-a4fc046d302c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:04.243379 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-c795ce78-4252-489f-8de6-a4fc046d302c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:04.251179 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c795ce78-4252-489f-8de6-a4fc046d302c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:04.251688 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c795ce78-4252-489f-8de6-a4fc046d302c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:04.252521 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c795ce78-4252-489f-8de6-a4fc046d302c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:04.253624 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c795ce78-4252-489f-8de6-a4fc046d302c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:04.468233 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-c795ce78-4252-489f-8de6-a4fc046d302c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:04.478204 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-c795ce78-4252-489f-8de6-a4fc046d302c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:04.479848 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-c795ce78-4252-489f-8de6-a4fc046d302c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:04.481035 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-c795ce78-4252-489f-8de6-a4fc046d302c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1754 microversion: 2.20 time: 0.242433 Feb 17 04:40:04.481633 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 260/515] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:40:04 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1754 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:40:04.761798 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-19bd07bc-5b06-462f-b805-db3f7f93d2ba tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:04.762469 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-19bd07bc-5b06-462f-b805-db3f7f93d2ba tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 68a5c561-c418-4a68-b8b3-1600b638b80c] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:04.771960 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-19bd07bc-5b06-462f-b805-db3f7f93d2ba tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:04.772487 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-19bd07bc-5b06-462f-b805-db3f7f93d2ba tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:04.773336 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-19bd07bc-5b06-462f-b805-db3f7f93d2ba tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:04.773828 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-19bd07bc-5b06-462f-b805-db3f7f93d2ba tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:04.995642 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-19bd07bc-5b06-462f-b805-db3f7f93d2ba tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:05.004951 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-19bd07bc-5b06-462f-b805-db3f7f93d2ba tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c" status: 200 len: 1548 microversion: 2.1 time: 0.247539 Feb 17 04:40:05.005609 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 256/516] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:04 2021] GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c => generated 1548 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:40:05.023785 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-ab771f93-6521-4ef4-b28e-7ce3a0db77ab tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:05.024330 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-ab771f93-6521-4ef4-b28e-7ce3a0db77ab tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 68a5c561-c418-4a68-b8b3-1600b638b80c] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:05.032515 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ab771f93-6521-4ef4-b28e-7ce3a0db77ab tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:05.033040 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ab771f93-6521-4ef4-b28e-7ce3a0db77ab tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:05.033902 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ab771f93-6521-4ef4-b28e-7ce3a0db77ab tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:05.035077 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ab771f93-6521-4ef4-b28e-7ce3a0db77ab tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:05.351237 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.wsgi [None req-ab771f93-6521-4ef4-b28e-7ce3a0db77ab tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] HTTP exception thrown: Cannot 'detach_volume' instance 68a5c561-c418-4a68-b8b3-1600b638b80c while it is in vm_state rescued Feb 17 04:40:05.351901 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-ab771f93-6521-4ef4-b28e-7ce3a0db77ab tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Returning 409 to user: Cannot 'detach_volume' instance 68a5c561-c418-4a68-b8b3-1600b638b80c while it is in vm_state rescued {{(pid=98080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:40:05.352806 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-ab771f93-6521-4ef4-b28e-7ce3a0db77ab tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "DELETE /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c/os-volume_attachments/9becb80b-6cb9-4cb4-a1ba-3fe9a5a5c011" status: 409 len: 152 microversion: 2.1 time: 0.334139 Feb 17 04:40:05.353417 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 261/517] 10.222.0.38 () {58 vars in 1406 bytes} [Wed Feb 17 04:40:05 2021] DELETE /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c/os-volume_attachments/9becb80b-6cb9-4cb4-a1ba-3fe9a5a5c011 => generated 152 bytes in 335 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Feb 17 04:40:05.362731 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-f2d7e06a-7ba6-4d96-a874-725ce2fff18e tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:40:05.363358 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-f2d7e06a-7ba6-4d96-a874-725ce2fff18e tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 68a5c561-c418-4a68-b8b3-1600b638b80c] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:05.371255 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f2d7e06a-7ba6-4d96-a874-725ce2fff18e tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:05.371763 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f2d7e06a-7ba6-4d96-a874-725ce2fff18e tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:05.372604 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f2d7e06a-7ba6-4d96-a874-725ce2fff18e tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:05.373095 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f2d7e06a-7ba6-4d96-a874-725ce2fff18e tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:05.501672 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-35e95ac1-c9a1-4590-8a27-fcdcb8a41173 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:05.502383 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-35e95ac1-c9a1-4590-8a27-fcdcb8a41173 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:05.511716 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-f2d7e06a-7ba6-4d96-a874-725ce2fff18e tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "POST /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c/action" status: 202 len: 0 microversion: 2.1 time: 0.153155 Feb 17 04:40:05.511887 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-35e95ac1-c9a1-4590-8a27-fcdcb8a41173 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:05.512289 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-35e95ac1-c9a1-4590-8a27-fcdcb8a41173 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:05.512489 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 257/518] 10.222.0.38 () {60 vars in 1268 bytes} [Wed Feb 17 04:40:05 2021] POST /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:40:05.513134 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-35e95ac1-c9a1-4590-8a27-fcdcb8a41173 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:05.513717 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-35e95ac1-c9a1-4590-8a27-fcdcb8a41173 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:05.522468 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-30956005-7eb0-46b6-a0b4-b82e0e3536f1 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:05.523262 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-30956005-7eb0-46b6-a0b4-b82e0e3536f1 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 68a5c561-c418-4a68-b8b3-1600b638b80c] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:05.531482 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-30956005-7eb0-46b6-a0b4-b82e0e3536f1 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:05.531998 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-30956005-7eb0-46b6-a0b4-b82e0e3536f1 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:05.532861 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-30956005-7eb0-46b6-a0b4-b82e0e3536f1 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:05.533349 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-30956005-7eb0-46b6-a0b4-b82e0e3536f1 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:05.830830 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-35e95ac1-c9a1-4590-8a27-fcdcb8a41173 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:05.840775 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-30956005-7eb0-46b6-a0b4-b82e0e3536f1 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:05.841304 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-35e95ac1-c9a1-4590-8a27-fcdcb8a41173 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:05.842909 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-35e95ac1-c9a1-4590-8a27-fcdcb8a41173 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:05.844141 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-35e95ac1-c9a1-4590-8a27-fcdcb8a41173 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1754 microversion: 2.20 time: 0.346574 Feb 17 04:40:05.844720 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 262/519] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:40:05 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1754 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:40:05.850944 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-30956005-7eb0-46b6-a0b4-b82e0e3536f1 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c" status: 200 len: 1556 microversion: 2.1 time: 0.333693 Feb 17 04:40:05.851511 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 258/520] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:05 2021] GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c => generated 1556 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:40:06.026435 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-2867024c-9860-4f66-9ab9-9f50775b6e2b tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:06.027016 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-2867024c-9860-4f66-9ab9-9f50775b6e2b tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] [instance: d9d6e198-85f5-488e-8317-d498205f37cc] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:06.035450 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2867024c-9860-4f66-9ab9-9f50775b6e2b tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:06.035964 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2867024c-9860-4f66-9ab9-9f50775b6e2b tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:06.036806 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2867024c-9860-4f66-9ab9-9f50775b6e2b tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:06.037305 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2867024c-9860-4f66-9ab9-9f50775b6e2b tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:06.104672 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-2867024c-9860-4f66-9ab9-9f50775b6e2b tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] [instance: d9d6e198-85f5-488e-8317-d498205f37cc] Going to try to terminate instance {{(pid=98080) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 04:40:06.216918 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-2867024c-9860-4f66-9ab9-9f50775b6e2b tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] 10.222.0.38 "DELETE /compute/v2.1/servers/d9d6e198-85f5-488e-8317-d498205f37cc" status: 204 len: 0 microversion: 2.1 time: 0.194147 Feb 17 04:40:06.217542 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 263/521] 10.222.0.38 () {58 vars in 1229 bytes} [Wed Feb 17 04:40:06 2021] DELETE /compute/v2.1/servers/d9d6e198-85f5-488e-8317-d498205f37cc => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 17 04:40:06.226899 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-b3cd1795-29c0-4783-ac9a-c9c2814aba37 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:06.227671 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-b3cd1795-29c0-4783-ac9a-c9c2814aba37 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] [instance: d9d6e198-85f5-488e-8317-d498205f37cc] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:06.235418 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b3cd1795-29c0-4783-ac9a-c9c2814aba37 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:06.235931 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b3cd1795-29c0-4783-ac9a-c9c2814aba37 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:06.236766 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b3cd1795-29c0-4783-ac9a-c9c2814aba37 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:06.237992 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b3cd1795-29c0-4783-ac9a-c9c2814aba37 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:06.455581 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-b3cd1795-29c0-4783-ac9a-c9c2814aba37 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a3efaa75e64645abf7555ccfe348d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b23386679f44b7e9d4204ab1e9adf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:06.466778 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-b3cd1795-29c0-4783-ac9a-c9c2814aba37 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] 10.222.0.38 "GET /compute/v2.1/servers/d9d6e198-85f5-488e-8317-d498205f37cc" status: 200 len: 1512 microversion: 2.1 time: 0.243207 Feb 17 04:40:06.467420 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 259/522] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:06 2021] GET /compute/v2.1/servers/d9d6e198-85f5-488e-8317-d498205f37cc => generated 1512 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:40:06.864736 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-c7c9ee72-e883-469d-8ea2-087f88decb87 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:06.865508 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-c7c9ee72-e883-469d-8ea2-087f88decb87 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:06.869194 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-0e967d05-d8bd-419f-9d0c-8efd32abf4a3 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:06.869866 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-0e967d05-d8bd-419f-9d0c-8efd32abf4a3 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 68a5c561-c418-4a68-b8b3-1600b638b80c] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:06.873376 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c7c9ee72-e883-469d-8ea2-087f88decb87 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:06.873882 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c7c9ee72-e883-469d-8ea2-087f88decb87 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:06.874743 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c7c9ee72-e883-469d-8ea2-087f88decb87 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:06.875240 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c7c9ee72-e883-469d-8ea2-087f88decb87 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:06.878125 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0e967d05-d8bd-419f-9d0c-8efd32abf4a3 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:06.878823 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0e967d05-d8bd-419f-9d0c-8efd32abf4a3 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:06.879602 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0e967d05-d8bd-419f-9d0c-8efd32abf4a3 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:06.880100 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0e967d05-d8bd-419f-9d0c-8efd32abf4a3 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:07.195660 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-c7c9ee72-e883-469d-8ea2-087f88decb87 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:07.199944 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-0e967d05-d8bd-419f-9d0c-8efd32abf4a3 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:07.206312 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-c7c9ee72-e883-469d-8ea2-087f88decb87 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:07.207931 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-c7c9ee72-e883-469d-8ea2-087f88decb87 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:07.209118 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-c7c9ee72-e883-469d-8ea2-087f88decb87 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1754 microversion: 2.20 time: 0.349036 Feb 17 04:40:07.209713 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 264/523] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:40:06 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1754 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:40:07.209841 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-0e967d05-d8bd-419f-9d0c-8efd32abf4a3 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c" status: 200 len: 1556 microversion: 2.1 time: 0.344660 Feb 17 04:40:07.210523 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 260/524] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:06 2021] GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c => generated 1556 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:40:07.485414 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-ba353e2d-cc41-4073-9404-c4d1ed1dc1f7 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:07.486082 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-ba353e2d-cc41-4073-9404-c4d1ed1dc1f7 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] [instance: d9d6e198-85f5-488e-8317-d498205f37cc] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:07.494489 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ba353e2d-cc41-4073-9404-c4d1ed1dc1f7 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:07.495042 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ba353e2d-cc41-4073-9404-c4d1ed1dc1f7 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:07.495844 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ba353e2d-cc41-4073-9404-c4d1ed1dc1f7 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:07.496311 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ba353e2d-cc41-4073-9404-c4d1ed1dc1f7 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:07.716925 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-ba353e2d-cc41-4073-9404-c4d1ed1dc1f7 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a3efaa75e64645abf7555ccfe348d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b23386679f44b7e9d4204ab1e9adf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:07.726318 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-ba353e2d-cc41-4073-9404-c4d1ed1dc1f7 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] 10.222.0.38 "GET /compute/v2.1/servers/d9d6e198-85f5-488e-8317-d498205f37cc" status: 200 len: 1512 microversion: 2.1 time: 0.244869 Feb 17 04:40:07.726948 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 265/525] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:07 2021] GET /compute/v2.1/servers/d9d6e198-85f5-488e-8317-d498205f37cc => generated 1512 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:40:08.228369 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-1a1ce72f-be0a-4dde-854e-c7986e7ef649 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:08.228676 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-92b6653c-3c94-4b2f-bc88-90d95fdc9438 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:08.229032 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-1a1ce72f-be0a-4dde-854e-c7986e7ef649 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 68a5c561-c418-4a68-b8b3-1600b638b80c] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:08.229348 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-92b6653c-3c94-4b2f-bc88-90d95fdc9438 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:08.239081 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-92b6653c-3c94-4b2f-bc88-90d95fdc9438 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:08.239616 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-92b6653c-3c94-4b2f-bc88-90d95fdc9438 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:08.240488 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-92b6653c-3c94-4b2f-bc88-90d95fdc9438 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:08.241009 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1a1ce72f-be0a-4dde-854e-c7986e7ef649 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:08.241155 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-92b6653c-3c94-4b2f-bc88-90d95fdc9438 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:08.241523 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1a1ce72f-be0a-4dde-854e-c7986e7ef649 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:08.242798 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1a1ce72f-be0a-4dde-854e-c7986e7ef649 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:08.243585 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1a1ce72f-be0a-4dde-854e-c7986e7ef649 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:08.783598 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-92b6653c-3c94-4b2f-bc88-90d95fdc9438 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:08.795377 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-92b6653c-3c94-4b2f-bc88-90d95fdc9438 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:08.797166 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-92b6653c-3c94-4b2f-bc88-90d95fdc9438 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:08.798469 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-92b6653c-3c94-4b2f-bc88-90d95fdc9438 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1754 microversion: 2.20 time: 0.573934 Feb 17 04:40:08.810853 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 266/526] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:40:08 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1754 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:40:08.811214 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-1a1ce72f-be0a-4dde-854e-c7986e7ef649 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:08.811312 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-268a96e4-fc8e-43b9-ba21-3346d815c8f3 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:08.811312 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-268a96e4-fc8e-43b9-ba21-3346d815c8f3 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] [instance: d9d6e198-85f5-488e-8317-d498205f37cc] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:08.814287 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-1a1ce72f-be0a-4dde-854e-c7986e7ef649 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c" status: 200 len: 1556 microversion: 2.1 time: 0.589774 Feb 17 04:40:08.814956 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 261/527] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:08 2021] GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c => generated 1556 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:40:08.822725 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-268a96e4-fc8e-43b9-ba21-3346d815c8f3 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:08.822725 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-268a96e4-fc8e-43b9-ba21-3346d815c8f3 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:08.822725 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-268a96e4-fc8e-43b9-ba21-3346d815c8f3 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:08.822725 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-268a96e4-fc8e-43b9-ba21-3346d815c8f3 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:09.308781 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-268a96e4-fc8e-43b9-ba21-3346d815c8f3 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a3efaa75e64645abf7555ccfe348d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b23386679f44b7e9d4204ab1e9adf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:09.318128 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-268a96e4-fc8e-43b9-ba21-3346d815c8f3 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] 10.222.0.38 "GET /compute/v2.1/servers/d9d6e198-85f5-488e-8317-d498205f37cc" status: 200 len: 1512 microversion: 2.1 time: 0.517673 Feb 17 04:40:09.318750 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 267/528] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:08 2021] GET /compute/v2.1/servers/d9d6e198-85f5-488e-8317-d498205f37cc => generated 1512 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:40:09.821136 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-f54b821a-9f6d-43a3-94a6-a94eac80c2ae tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:09.821846 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-f54b821a-9f6d-43a3-94a6-a94eac80c2ae tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:09.829769 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f54b821a-9f6d-43a3-94a6-a94eac80c2ae tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:09.830272 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f54b821a-9f6d-43a3-94a6-a94eac80c2ae tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:09.831927 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f54b821a-9f6d-43a3-94a6-a94eac80c2ae tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:09.832477 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f54b821a-9f6d-43a3-94a6-a94eac80c2ae tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:09.834087 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-abc0f17c-1d06-4860-8314-7100ba4660df tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:09.834779 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-abc0f17c-1d06-4860-8314-7100ba4660df tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 68a5c561-c418-4a68-b8b3-1600b638b80c] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:09.842444 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-abc0f17c-1d06-4860-8314-7100ba4660df tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:09.842988 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-abc0f17c-1d06-4860-8314-7100ba4660df tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:09.843813 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-abc0f17c-1d06-4860-8314-7100ba4660df tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:09.844304 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-abc0f17c-1d06-4860-8314-7100ba4660df tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:10.159248 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-f54b821a-9f6d-43a3-94a6-a94eac80c2ae tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:10.167437 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-abc0f17c-1d06-4860-8314-7100ba4660df tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:10.171326 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-f54b821a-9f6d-43a3-94a6-a94eac80c2ae tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:10.172905 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-f54b821a-9f6d-43a3-94a6-a94eac80c2ae tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:10.174105 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-f54b821a-9f6d-43a3-94a6-a94eac80c2ae tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1754 microversion: 2.20 time: 0.357063 Feb 17 04:40:10.174715 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 262/529] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:40:09 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1754 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:40:10.176984 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-abc0f17c-1d06-4860-8314-7100ba4660df tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c" status: 200 len: 1556 microversion: 2.1 time: 0.347543 Feb 17 04:40:10.177569 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 268/530] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:09 2021] GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c => generated 1556 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:40:10.336672 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-da6cface-5de3-4f08-9f48-d96494c96c86 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:10.337340 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-da6cface-5de3-4f08-9f48-d96494c96c86 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] [instance: d9d6e198-85f5-488e-8317-d498205f37cc] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:10.345191 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-da6cface-5de3-4f08-9f48-d96494c96c86 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:10.345699 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-da6cface-5de3-4f08-9f48-d96494c96c86 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:10.346581 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-da6cface-5de3-4f08-9f48-d96494c96c86 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:10.347076 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-da6cface-5de3-4f08-9f48-d96494c96c86 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:10.555727 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-da6cface-5de3-4f08-9f48-d96494c96c86 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a3efaa75e64645abf7555ccfe348d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b23386679f44b7e9d4204ab1e9adf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:10.564795 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-da6cface-5de3-4f08-9f48-d96494c96c86 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] 10.222.0.38 "GET /compute/v2.1/servers/d9d6e198-85f5-488e-8317-d498205f37cc" status: 200 len: 1512 microversion: 2.1 time: 0.232078 Feb 17 04:40:10.566506 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 263/531] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:10 2021] GET /compute/v2.1/servers/d9d6e198-85f5-488e-8317-d498205f37cc => generated 1512 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:40:11.193949 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-d80556cf-50e6-47c3-8c38-517124edf22c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:11.194642 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-d80556cf-50e6-47c3-8c38-517124edf22c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:11.195110 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-32b8a347-177f-4919-897d-a6aedaab4d8e tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:11.195773 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-32b8a347-177f-4919-897d-a6aedaab4d8e tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 68a5c561-c418-4a68-b8b3-1600b638b80c] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:11.202464 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d80556cf-50e6-47c3-8c38-517124edf22c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:11.203009 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d80556cf-50e6-47c3-8c38-517124edf22c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:11.203597 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-32b8a347-177f-4919-897d-a6aedaab4d8e tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:11.203853 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d80556cf-50e6-47c3-8c38-517124edf22c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:11.204103 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-32b8a347-177f-4919-897d-a6aedaab4d8e tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:11.204347 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d80556cf-50e6-47c3-8c38-517124edf22c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:11.204932 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-32b8a347-177f-4919-897d-a6aedaab4d8e tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:11.205421 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-32b8a347-177f-4919-897d-a6aedaab4d8e tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:11.524629 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-d80556cf-50e6-47c3-8c38-517124edf22c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:11.529481 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-32b8a347-177f-4919-897d-a6aedaab4d8e tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:11.535672 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-d80556cf-50e6-47c3-8c38-517124edf22c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:11.537316 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-d80556cf-50e6-47c3-8c38-517124edf22c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:11.538502 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-d80556cf-50e6-47c3-8c38-517124edf22c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1754 microversion: 2.20 time: 0.348977 Feb 17 04:40:11.539122 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 269/532] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:40:11 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1754 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 04:40:11.540129 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-32b8a347-177f-4919-897d-a6aedaab4d8e tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c" status: 200 len: 1556 microversion: 2.1 time: 0.349030 Feb 17 04:40:11.540723 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 264/533] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:11 2021] GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c => generated 1556 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:40:11.584202 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-23912484-7113-4b65-9b5f-291c73bd00f4 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:11.584877 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-23912484-7113-4b65-9b5f-291c73bd00f4 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] [instance: d9d6e198-85f5-488e-8317-d498205f37cc] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:11.592743 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-23912484-7113-4b65-9b5f-291c73bd00f4 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:11.593203 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-23912484-7113-4b65-9b5f-291c73bd00f4 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:11.594077 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-23912484-7113-4b65-9b5f-291c73bd00f4 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:11.594748 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-23912484-7113-4b65-9b5f-291c73bd00f4 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:11.802445 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-23912484-7113-4b65-9b5f-291c73bd00f4 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a3efaa75e64645abf7555ccfe348d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b23386679f44b7e9d4204ab1e9adf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:11.812005 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-23912484-7113-4b65-9b5f-291c73bd00f4 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] 10.222.0.38 "GET /compute/v2.1/servers/d9d6e198-85f5-488e-8317-d498205f37cc" status: 200 len: 1512 microversion: 2.1 time: 0.232094 Feb 17 04:40:11.812608 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 270/534] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:11 2021] GET /compute/v2.1/servers/d9d6e198-85f5-488e-8317-d498205f37cc => generated 1512 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:40:12.557474 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-ef73ede1-84b0-453f-be63-78f746b35bcc tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:12.558013 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-2d2c6821-1d92-413c-a575-8ffbe7fa39f5 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:12.558115 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-2d2c6821-1d92-413c-a575-8ffbe7fa39f5 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:12.558266 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-ef73ede1-84b0-453f-be63-78f746b35bcc tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 68a5c561-c418-4a68-b8b3-1600b638b80c] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:12.567260 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ef73ede1-84b0-453f-be63-78f746b35bcc tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:12.567438 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2d2c6821-1d92-413c-a575-8ffbe7fa39f5 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:12.567712 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ef73ede1-84b0-453f-be63-78f746b35bcc tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:12.568057 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2d2c6821-1d92-413c-a575-8ffbe7fa39f5 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:12.568691 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ef73ede1-84b0-453f-be63-78f746b35bcc tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:12.569068 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2d2c6821-1d92-413c-a575-8ffbe7fa39f5 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:12.569167 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ef73ede1-84b0-453f-be63-78f746b35bcc tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:12.569668 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2d2c6821-1d92-413c-a575-8ffbe7fa39f5 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:13.111117 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-2d2c6821-1d92-413c-a575-8ffbe7fa39f5 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:13.125507 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-2d2c6821-1d92-413c-a575-8ffbe7fa39f5 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:13.126333 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-ef73ede1-84b0-453f-be63-78f746b35bcc tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:13.128396 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-2d2c6821-1d92-413c-a575-8ffbe7fa39f5 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:13.131258 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-2d2c6821-1d92-413c-a575-8ffbe7fa39f5 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1754 microversion: 2.20 time: 0.576853 Feb 17 04:40:13.135453 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 271/535] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:40:12 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1754 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:40:13.136561 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-57a3044e-6bc4-4e23-ac94-c921d407a40e tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:13.137395 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-57a3044e-6bc4-4e23-ac94-c921d407a40e tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] [instance: d9d6e198-85f5-488e-8317-d498205f37cc] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:13.145988 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-ef73ede1-84b0-453f-be63-78f746b35bcc tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c" status: 200 len: 1556 microversion: 2.1 time: 0.592212 Feb 17 04:40:13.146682 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-57a3044e-6bc4-4e23-ac94-c921d407a40e tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:13.147748 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-57a3044e-6bc4-4e23-ac94-c921d407a40e tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:13.147977 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 265/536] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:12 2021] GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c => generated 1556 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:40:13.155092 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-57a3044e-6bc4-4e23-ac94-c921d407a40e tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:13.155092 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-57a3044e-6bc4-4e23-ac94-c921d407a40e tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:13.766981 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-57a3044e-6bc4-4e23-ac94-c921d407a40e tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a3efaa75e64645abf7555ccfe348d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b23386679f44b7e9d4204ab1e9adf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:13.776355 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-57a3044e-6bc4-4e23-ac94-c921d407a40e tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] 10.222.0.38 "GET /compute/v2.1/servers/d9d6e198-85f5-488e-8317-d498205f37cc" status: 200 len: 1512 microversion: 2.1 time: 0.643581 Feb 17 04:40:13.777364 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 272/537] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:13 2021] GET /compute/v2.1/servers/d9d6e198-85f5-488e-8317-d498205f37cc => generated 1512 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:40:14.150556 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-9246fc97-fddb-4fdb-a7c1-e903c40ac97f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:14.151260 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-9246fc97-fddb-4fdb-a7c1-e903c40ac97f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:14.159276 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9246fc97-fddb-4fdb-a7c1-e903c40ac97f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:14.160016 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9246fc97-fddb-4fdb-a7c1-e903c40ac97f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:14.161031 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9246fc97-fddb-4fdb-a7c1-e903c40ac97f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:14.161725 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9246fc97-fddb-4fdb-a7c1-e903c40ac97f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:14.165117 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-10551d27-9843-4fa7-8c54-0df6d88ad917 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:14.166132 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-10551d27-9843-4fa7-8c54-0df6d88ad917 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 68a5c561-c418-4a68-b8b3-1600b638b80c] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:14.174967 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-10551d27-9843-4fa7-8c54-0df6d88ad917 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:14.175543 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-10551d27-9843-4fa7-8c54-0df6d88ad917 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:14.176589 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-10551d27-9843-4fa7-8c54-0df6d88ad917 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:14.177070 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-10551d27-9843-4fa7-8c54-0df6d88ad917 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:14.601194 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-9246fc97-fddb-4fdb-a7c1-e903c40ac97f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:14.625066 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-10551d27-9843-4fa7-8c54-0df6d88ad917 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:14.631833 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-9246fc97-fddb-4fdb-a7c1-e903c40ac97f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:14.633747 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-9246fc97-fddb-4fdb-a7c1-e903c40ac97f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:14.635032 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-9246fc97-fddb-4fdb-a7c1-e903c40ac97f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1810 microversion: 2.20 time: 0.488496 Feb 17 04:40:14.635613 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 266/538] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:40:14 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1810 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:40:14.635819 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-10551d27-9843-4fa7-8c54-0df6d88ad917 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c" status: 200 len: 1556 microversion: 2.1 time: 0.474932 Feb 17 04:40:14.637285 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 273/539] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:14 2021] GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c => generated 1556 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:40:14.646471 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [req-a6ae0919-73aa-4784-8b81-b18f998dd5be req-405e74f7-e1cf-420d-98a9-3913cc05a98f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9d6e198-85f5-488e-8317-d498205f37cc", "name": "network-vif-deleted", "tag": "5d940ae4-3a6b-4f9e-94a7-67aabf2dbacb"}]} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:40:14.648413 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:40:14.648413 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:40:14.668592 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-a6ae0919-73aa-4784-8b81-b18f998dd5be req-405e74f7-e1cf-420d-98a9-3913cc05a98f service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:14.669209 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-a6ae0919-73aa-4784-8b81-b18f998dd5be req-405e74f7-e1cf-420d-98a9-3913cc05a98f service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:14.695885 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.compute.server_external_events [req-a6ae0919-73aa-4784-8b81-b18f998dd5be req-405e74f7-e1cf-420d-98a9-3913cc05a98f service nova] Creating event network-vif-deleted:5d940ae4-3a6b-4f9e-94a7-67aabf2dbacb for instance d9d6e198-85f5-488e-8317-d498205f37cc on hv-cinder-76019 Feb 17 04:40:14.702750 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [req-a6ae0919-73aa-4784-8b81-b18f998dd5be req-405e74f7-e1cf-420d-98a9-3913cc05a98f service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065272 Feb 17 04:40:14.706972 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 267/540] 10.222.0.38 () {64 vars in 1308 bytes} [Wed Feb 17 04:40:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:40:14.795942 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-c574e4c6-5252-4a35-a3a8-333f395fe081 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:14.797503 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-c574e4c6-5252-4a35-a3a8-333f395fe081 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] [instance: d9d6e198-85f5-488e-8317-d498205f37cc] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:14.819128 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c574e4c6-5252-4a35-a3a8-333f395fe081 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:14.819812 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c574e4c6-5252-4a35-a3a8-333f395fe081 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:14.821150 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c574e4c6-5252-4a35-a3a8-333f395fe081 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:14.821941 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c574e4c6-5252-4a35-a3a8-333f395fe081 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:14.926704 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c574e4c6-5252-4a35-a3a8-333f395fe081 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:14.931464 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c574e4c6-5252-4a35-a3a8-333f395fe081 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:14.932273 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.objects.instance [None req-c574e4c6-5252-4a35-a3a8-333f395fe081 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lazy-loading 'fault' on Instance uuid d9d6e198-85f5-488e-8317-d498205f37cc {{(pid=98080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:40:15.041046 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-c574e4c6-5252-4a35-a3a8-333f395fe081 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a3efaa75e64645abf7555ccfe348d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b23386679f44b7e9d4204ab1e9adf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:15.056820 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-c574e4c6-5252-4a35-a3a8-333f395fe081 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] 10.222.0.38 "GET /compute/v2.1/servers/d9d6e198-85f5-488e-8317-d498205f37cc" status: 200 len: 1308 microversion: 2.1 time: 0.264634 Feb 17 04:40:15.057440 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 274/541] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:14 2021] GET /compute/v2.1/servers/d9d6e198-85f5-488e-8317-d498205f37cc => generated 1308 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:40:15.656096 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-8ec249e2-a136-42ba-bb62-f9d1864b62dd tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:15.657147 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-8ec249e2-a136-42ba-bb62-f9d1864b62dd tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:15.659236 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-8852d485-51b2-474a-9456-6106d82e2d95 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:15.660198 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-8852d485-51b2-474a-9456-6106d82e2d95 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 68a5c561-c418-4a68-b8b3-1600b638b80c] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:15.667136 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8ec249e2-a136-42ba-bb62-f9d1864b62dd tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:15.667647 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8ec249e2-a136-42ba-bb62-f9d1864b62dd tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:15.668500 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8ec249e2-a136-42ba-bb62-f9d1864b62dd tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:15.668878 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8852d485-51b2-474a-9456-6106d82e2d95 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:15.669008 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8ec249e2-a136-42ba-bb62-f9d1864b62dd tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:15.669403 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8852d485-51b2-474a-9456-6106d82e2d95 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:15.670239 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8852d485-51b2-474a-9456-6106d82e2d95 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:15.670930 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8852d485-51b2-474a-9456-6106d82e2d95 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:16.285495 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-8852d485-51b2-474a-9456-6106d82e2d95 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:16.298030 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-8852d485-51b2-474a-9456-6106d82e2d95 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c" status: 200 len: 1562 microversion: 2.1 time: 0.642466 Feb 17 04:40:16.298030 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 275/542] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:15 2021] GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c => generated 1562 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:40:16.309512 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-6b48cfe6-17ea-4031-a819-aae3d3772106 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:16.310450 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-6b48cfe6-17ea-4031-a819-aae3d3772106 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] [instance: d9d6e198-85f5-488e-8317-d498205f37cc] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:16.313964 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-8ec249e2-a136-42ba-bb62-f9d1864b62dd tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:16.319483 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6b48cfe6-17ea-4031-a819-aae3d3772106 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:16.319993 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6b48cfe6-17ea-4031-a819-aae3d3772106 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:16.320849 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6b48cfe6-17ea-4031-a819-aae3d3772106 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:16.321343 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6b48cfe6-17ea-4031-a819-aae3d3772106 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:16.337114 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-8ec249e2-a136-42ba-bb62-f9d1864b62dd tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:16.338733 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-8ec249e2-a136-42ba-bb62-f9d1864b62dd tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:16.339958 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-8ec249e2-a136-42ba-bb62-f9d1864b62dd tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1810 microversion: 2.20 time: 0.689024 Feb 17 04:40:16.344364 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 268/543] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:40:15 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1810 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:40:16.403546 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6b48cfe6-17ea-4031-a819-aae3d3772106 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:16.404057 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6b48cfe6-17ea-4031-a819-aae3d3772106 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:16.404580 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.objects.instance [None req-6b48cfe6-17ea-4031-a819-aae3d3772106 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lazy-loading 'fault' on Instance uuid d9d6e198-85f5-488e-8317-d498205f37cc {{(pid=98080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:40:16.474401 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-6b48cfe6-17ea-4031-a819-aae3d3772106 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a3efaa75e64645abf7555ccfe348d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b23386679f44b7e9d4204ab1e9adf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:16.483674 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-6b48cfe6-17ea-4031-a819-aae3d3772106 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] 10.222.0.38 "GET /compute/v2.1/servers/d9d6e198-85f5-488e-8317-d498205f37cc" status: 200 len: 1308 microversion: 2.1 time: 0.184729 Feb 17 04:40:16.484286 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 276/544] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:16 2021] GET /compute/v2.1/servers/d9d6e198-85f5-488e-8317-d498205f37cc => generated 1308 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:40:16.602699 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-43b081d5-6d6c-4bcd-a50b-5a780f28232b tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:16.603259 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-43b081d5-6d6c-4bcd-a50b-5a780f28232b tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 68a5c561-c418-4a68-b8b3-1600b638b80c] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:16.611443 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-43b081d5-6d6c-4bcd-a50b-5a780f28232b tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:16.612700 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-43b081d5-6d6c-4bcd-a50b-5a780f28232b tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:16.613855 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-43b081d5-6d6c-4bcd-a50b-5a780f28232b tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:16.614403 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-43b081d5-6d6c-4bcd-a50b-5a780f28232b tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:16.803352 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.objects.instance [None req-43b081d5-6d6c-4bcd-a50b-5a780f28232b tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lazy-loading 'services' on Instance uuid 68a5c561-c418-4a68-b8b3-1600b638b80c {{(pid=98081) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:40:16.952960 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-43b081d5-6d6c-4bcd-a50b-5a780f28232b tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "DELETE /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c/os-volume_attachments/9becb80b-6cb9-4cb4-a1ba-3fe9a5a5c011" status: 202 len: 0 microversion: 2.1 time: 0.354146 Feb 17 04:40:16.953849 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 269/545] 10.222.0.38 () {58 vars in 1406 bytes} [Wed Feb 17 04:40:16 2021] DELETE /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c/os-volume_attachments/9becb80b-6cb9-4cb4-a1ba-3fe9a5a5c011 => generated 0 bytes in 356 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:40:17.359685 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-00d109c9-428c-4d17-81bd-b9a85fa974c3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:17.360377 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-00d109c9-428c-4d17-81bd-b9a85fa974c3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:17.368378 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-00d109c9-428c-4d17-81bd-b9a85fa974c3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:17.368890 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-00d109c9-428c-4d17-81bd-b9a85fa974c3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:17.369717 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-00d109c9-428c-4d17-81bd-b9a85fa974c3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:17.370211 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-00d109c9-428c-4d17-81bd-b9a85fa974c3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:17.504852 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-cb9c877f-061f-478c-a53c-cad95e12e330 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:17.505827 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-cb9c877f-061f-478c-a53c-cad95e12e330 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] [instance: d9d6e198-85f5-488e-8317-d498205f37cc] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:17.515434 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-cb9c877f-061f-478c-a53c-cad95e12e330 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:17.515997 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-cb9c877f-061f-478c-a53c-cad95e12e330 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:17.516875 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-cb9c877f-061f-478c-a53c-cad95e12e330 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:17.517382 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-cb9c877f-061f-478c-a53c-cad95e12e330 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:17.616677 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-00d109c9-428c-4d17-81bd-b9a85fa974c3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:17.624541 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-cb9c877f-061f-478c-a53c-cad95e12e330 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:17.625350 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-cb9c877f-061f-478c-a53c-cad95e12e330 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:17.625880 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.objects.instance [None req-cb9c877f-061f-478c-a53c-cad95e12e330 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lazy-loading 'fault' on Instance uuid d9d6e198-85f5-488e-8317-d498205f37cc {{(pid=98081) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:40:17.627506 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-00d109c9-428c-4d17-81bd-b9a85fa974c3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:17.629250 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-00d109c9-428c-4d17-81bd-b9a85fa974c3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:17.630457 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-00d109c9-428c-4d17-81bd-b9a85fa974c3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1810 microversion: 2.20 time: 0.274847 Feb 17 04:40:17.638520 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 277/546] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:40:17 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1810 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:40:17.703173 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-cb9c877f-061f-478c-a53c-cad95e12e330 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a3efaa75e64645abf7555ccfe348d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b23386679f44b7e9d4204ab1e9adf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:17.716830 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-cb9c877f-061f-478c-a53c-cad95e12e330 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] 10.222.0.38 "GET /compute/v2.1/servers/d9d6e198-85f5-488e-8317-d498205f37cc" status: 200 len: 1308 microversion: 2.1 time: 0.218233 Feb 17 04:40:17.717820 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 270/547] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:17 2021] GET /compute/v2.1/servers/d9d6e198-85f5-488e-8317-d498205f37cc => generated 1308 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:40:18.651707 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-c970f5af-4eae-47e8-a1ea-c98fd5155035 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:18.652389 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-c970f5af-4eae-47e8-a1ea-c98fd5155035 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:18.660565 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c970f5af-4eae-47e8-a1ea-c98fd5155035 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:18.661080 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c970f5af-4eae-47e8-a1ea-c98fd5155035 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:18.661942 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c970f5af-4eae-47e8-a1ea-c98fd5155035 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:18.662448 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c970f5af-4eae-47e8-a1ea-c98fd5155035 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:18.740092 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-d151a3df-b58c-4a2a-ad6b-7ebc86d0e18e tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:18.741668 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-d151a3df-b58c-4a2a-ad6b-7ebc86d0e18e tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] [instance: d9d6e198-85f5-488e-8317-d498205f37cc] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:18.763218 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d151a3df-b58c-4a2a-ad6b-7ebc86d0e18e tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:18.764961 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d151a3df-b58c-4a2a-ad6b-7ebc86d0e18e tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:18.766057 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d151a3df-b58c-4a2a-ad6b-7ebc86d0e18e tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:18.766589 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d151a3df-b58c-4a2a-ad6b-7ebc86d0e18e tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:18.858061 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d151a3df-b58c-4a2a-ad6b-7ebc86d0e18e tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:18.858601 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d151a3df-b58c-4a2a-ad6b-7ebc86d0e18e tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:18.859134 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.objects.instance [None req-d151a3df-b58c-4a2a-ad6b-7ebc86d0e18e tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lazy-loading 'fault' on Instance uuid d9d6e198-85f5-488e-8317-d498205f37cc {{(pid=98081) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:40:18.957966 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-d151a3df-b58c-4a2a-ad6b-7ebc86d0e18e tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a3efaa75e64645abf7555ccfe348d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b23386679f44b7e9d4204ab1e9adf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:18.962307 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-c970f5af-4eae-47e8-a1ea-c98fd5155035 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:18.972964 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-d151a3df-b58c-4a2a-ad6b-7ebc86d0e18e tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] 10.222.0.38 "GET /compute/v2.1/servers/d9d6e198-85f5-488e-8317-d498205f37cc" status: 200 len: 1308 microversion: 2.1 time: 0.234931 Feb 17 04:40:18.973799 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 271/548] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:18 2021] GET /compute/v2.1/servers/d9d6e198-85f5-488e-8317-d498205f37cc => generated 1308 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:40:18.977946 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-c970f5af-4eae-47e8-a1ea-c98fd5155035 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:18.979578 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-c970f5af-4eae-47e8-a1ea-c98fd5155035 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:18.980778 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-c970f5af-4eae-47e8-a1ea-c98fd5155035 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1810 microversion: 2.20 time: 0.333068 Feb 17 04:40:18.981341 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 278/549] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:40:18 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1810 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:40:19.992438 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-24d44342-8256-494f-974a-036878f11c62 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:19.993766 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-24d44342-8256-494f-974a-036878f11c62 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] [instance: d9d6e198-85f5-488e-8317-d498205f37cc] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:20.003402 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-10ff075b-c025-41ce-801e-fc33ba1a8425 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:20.003633 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-24d44342-8256-494f-974a-036878f11c62 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:20.004124 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-24d44342-8256-494f-974a-036878f11c62 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:20.004701 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-10ff075b-c025-41ce-801e-fc33ba1a8425 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:20.005415 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-24d44342-8256-494f-974a-036878f11c62 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:20.006487 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-24d44342-8256-494f-974a-036878f11c62 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:20.014676 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-10ff075b-c025-41ce-801e-fc33ba1a8425 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:20.015379 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-10ff075b-c025-41ce-801e-fc33ba1a8425 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:20.017054 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-10ff075b-c025-41ce-801e-fc33ba1a8425 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:20.017905 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-10ff075b-c025-41ce-801e-fc33ba1a8425 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:20.117420 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-24d44342-8256-494f-974a-036878f11c62 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:20.118266 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-24d44342-8256-494f-974a-036878f11c62 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:20.122604 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.objects.instance [None req-24d44342-8256-494f-974a-036878f11c62 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lazy-loading 'fault' on Instance uuid d9d6e198-85f5-488e-8317-d498205f37cc {{(pid=98081) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:40:20.241681 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-24d44342-8256-494f-974a-036878f11c62 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a3efaa75e64645abf7555ccfe348d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b23386679f44b7e9d4204ab1e9adf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:20.251331 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-24d44342-8256-494f-974a-036878f11c62 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] 10.222.0.38 "GET /compute/v2.1/servers/d9d6e198-85f5-488e-8317-d498205f37cc" status: 200 len: 1308 microversion: 2.1 time: 0.263716 Feb 17 04:40:20.251877 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 272/550] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:19 2021] GET /compute/v2.1/servers/d9d6e198-85f5-488e-8317-d498205f37cc => generated 1308 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:40:20.329684 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-10ff075b-c025-41ce-801e-fc33ba1a8425 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:20.339741 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-10ff075b-c025-41ce-801e-fc33ba1a8425 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:20.341323 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-10ff075b-c025-41ce-801e-fc33ba1a8425 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:20.342525 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-10ff075b-c025-41ce-801e-fc33ba1a8425 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1810 microversion: 2.20 time: 0.344976 Feb 17 04:40:20.343395 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 279/551] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:40:19 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1810 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:40:21.270073 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-1f2ab4e2-6de7-4803-81e9-fa87c097e41d tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:21.270740 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-1f2ab4e2-6de7-4803-81e9-fa87c097e41d tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] [instance: d9d6e198-85f5-488e-8317-d498205f37cc] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:21.279020 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1f2ab4e2-6de7-4803-81e9-fa87c097e41d tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:21.279514 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1f2ab4e2-6de7-4803-81e9-fa87c097e41d tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:21.280562 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1f2ab4e2-6de7-4803-81e9-fa87c097e41d tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:21.281250 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1f2ab4e2-6de7-4803-81e9-fa87c097e41d tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:21.358903 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1f2ab4e2-6de7-4803-81e9-fa87c097e41d tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:21.359417 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1f2ab4e2-6de7-4803-81e9-fa87c097e41d tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:21.359930 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.objects.instance [None req-1f2ab4e2-6de7-4803-81e9-fa87c097e41d tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lazy-loading 'fault' on Instance uuid d9d6e198-85f5-488e-8317-d498205f37cc {{(pid=98081) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:40:21.363172 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-ded030ba-e4d6-4961-8b70-474a8809769f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:21.363850 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-ded030ba-e4d6-4961-8b70-474a8809769f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:21.374499 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ded030ba-e4d6-4961-8b70-474a8809769f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:21.375390 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ded030ba-e4d6-4961-8b70-474a8809769f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:21.376402 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ded030ba-e4d6-4961-8b70-474a8809769f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:21.376890 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ded030ba-e4d6-4961-8b70-474a8809769f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:21.426756 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-1f2ab4e2-6de7-4803-81e9-fa87c097e41d tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a3efaa75e64645abf7555ccfe348d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b23386679f44b7e9d4204ab1e9adf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:21.438133 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-1f2ab4e2-6de7-4803-81e9-fa87c097e41d tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] 10.222.0.38 "GET /compute/v2.1/servers/d9d6e198-85f5-488e-8317-d498205f37cc" status: 200 len: 1308 microversion: 2.1 time: 0.172616 Feb 17 04:40:21.438975 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 273/552] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:21 2021] GET /compute/v2.1/servers/d9d6e198-85f5-488e-8317-d498205f37cc => generated 1308 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:40:21.620663 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-ded030ba-e4d6-4961-8b70-474a8809769f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:21.631075 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-ded030ba-e4d6-4961-8b70-474a8809769f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:21.632645 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-ded030ba-e4d6-4961-8b70-474a8809769f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:21.633843 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-ded030ba-e4d6-4961-8b70-474a8809769f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1810 microversion: 2.20 time: 0.275233 Feb 17 04:40:21.634437 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 280/553] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:40:21 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1810 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 04:40:22.456415 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-4feffe7f-8641-44eb-8ca0-f312347ae812 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:22.457138 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-4feffe7f-8641-44eb-8ca0-f312347ae812 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] [instance: d9d6e198-85f5-488e-8317-d498205f37cc] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:22.464980 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4feffe7f-8641-44eb-8ca0-f312347ae812 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:22.465494 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4feffe7f-8641-44eb-8ca0-f312347ae812 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:22.466834 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4feffe7f-8641-44eb-8ca0-f312347ae812 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:22.467340 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4feffe7f-8641-44eb-8ca0-f312347ae812 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:22.544638 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4feffe7f-8641-44eb-8ca0-f312347ae812 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:22.545211 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4feffe7f-8641-44eb-8ca0-f312347ae812 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:22.545671 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.objects.instance [None req-4feffe7f-8641-44eb-8ca0-f312347ae812 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lazy-loading 'fault' on Instance uuid d9d6e198-85f5-488e-8317-d498205f37cc {{(pid=98081) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:40:22.616877 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-4feffe7f-8641-44eb-8ca0-f312347ae812 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a3efaa75e64645abf7555ccfe348d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b23386679f44b7e9d4204ab1e9adf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:22.625838 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-4feffe7f-8641-44eb-8ca0-f312347ae812 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] 10.222.0.38 "GET /compute/v2.1/servers/d9d6e198-85f5-488e-8317-d498205f37cc" status: 200 len: 1308 microversion: 2.1 time: 0.173401 Feb 17 04:40:22.626669 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 274/554] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:22 2021] GET /compute/v2.1/servers/d9d6e198-85f5-488e-8317-d498205f37cc => generated 1308 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:40:22.655449 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-53a0a1b9-402f-4a10-a5f5-fc73f6f4b83b tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:22.656496 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-53a0a1b9-402f-4a10-a5f5-fc73f6f4b83b tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:22.677277 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-53a0a1b9-402f-4a10-a5f5-fc73f6f4b83b tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:22.677903 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-53a0a1b9-402f-4a10-a5f5-fc73f6f4b83b tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:22.678898 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-53a0a1b9-402f-4a10-a5f5-fc73f6f4b83b tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:22.679404 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-53a0a1b9-402f-4a10-a5f5-fc73f6f4b83b tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:22.909789 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-53a0a1b9-402f-4a10-a5f5-fc73f6f4b83b tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:22.920027 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-53a0a1b9-402f-4a10-a5f5-fc73f6f4b83b tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:22.921592 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-53a0a1b9-402f-4a10-a5f5-fc73f6f4b83b tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:22.922815 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-53a0a1b9-402f-4a10-a5f5-fc73f6f4b83b tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1810 microversion: 2.20 time: 0.272116 Feb 17 04:40:22.923411 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 281/555] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:40:22 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1810 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:40:23.644686 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-18d77633-e04d-4e61-b75f-b55961fd2a48 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:23.645357 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-18d77633-e04d-4e61-b75f-b55961fd2a48 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] [instance: d9d6e198-85f5-488e-8317-d498205f37cc] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:23.653380 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-18d77633-e04d-4e61-b75f-b55961fd2a48 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:23.653885 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-18d77633-e04d-4e61-b75f-b55961fd2a48 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:23.654760 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-18d77633-e04d-4e61-b75f-b55961fd2a48 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:23.655254 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-18d77633-e04d-4e61-b75f-b55961fd2a48 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:23.737127 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-18d77633-e04d-4e61-b75f-b55961fd2a48 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:23.737649 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-18d77633-e04d-4e61-b75f-b55961fd2a48 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:23.738988 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.objects.instance [None req-18d77633-e04d-4e61-b75f-b55961fd2a48 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lazy-loading 'fault' on Instance uuid d9d6e198-85f5-488e-8317-d498205f37cc {{(pid=98081) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:40:23.825727 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-18d77633-e04d-4e61-b75f-b55961fd2a48 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a3efaa75e64645abf7555ccfe348d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b23386679f44b7e9d4204ab1e9adf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:23.836829 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-18d77633-e04d-4e61-b75f-b55961fd2a48 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] 10.222.0.38 "GET /compute/v2.1/servers/d9d6e198-85f5-488e-8317-d498205f37cc" status: 200 len: 1308 microversion: 2.1 time: 0.196194 Feb 17 04:40:23.837758 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 275/556] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:23 2021] GET /compute/v2.1/servers/d9d6e198-85f5-488e-8317-d498205f37cc => generated 1308 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:40:23.945272 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-b9da72c8-10de-4924-a119-58585f0e3106 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:23.945887 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-b9da72c8-10de-4924-a119-58585f0e3106 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:23.954824 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b9da72c8-10de-4924-a119-58585f0e3106 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:23.955451 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b9da72c8-10de-4924-a119-58585f0e3106 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:23.956393 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b9da72c8-10de-4924-a119-58585f0e3106 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:23.957723 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b9da72c8-10de-4924-a119-58585f0e3106 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:24.179685 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-b9da72c8-10de-4924-a119-58585f0e3106 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:24.189699 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-b9da72c8-10de-4924-a119-58585f0e3106 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:24.191886 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-b9da72c8-10de-4924-a119-58585f0e3106 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:24.193572 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-b9da72c8-10de-4924-a119-58585f0e3106 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1810 microversion: 2.20 time: 0.253551 Feb 17 04:40:24.194158 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 282/557] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:40:23 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1810 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:40:24.856991 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-1de23a88-bef2-4606-a9b8-2f2ad181d067 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:24.857665 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-1de23a88-bef2-4606-a9b8-2f2ad181d067 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] [instance: d9d6e198-85f5-488e-8317-d498205f37cc] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:24.868751 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1de23a88-bef2-4606-a9b8-2f2ad181d067 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:24.869246 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1de23a88-bef2-4606-a9b8-2f2ad181d067 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:24.870086 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1de23a88-bef2-4606-a9b8-2f2ad181d067 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:24.870606 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1de23a88-bef2-4606-a9b8-2f2ad181d067 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:24.999364 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1de23a88-bef2-4606-a9b8-2f2ad181d067 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:24.999893 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1de23a88-bef2-4606-a9b8-2f2ad181d067 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:25.000486 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.objects.instance [None req-1de23a88-bef2-4606-a9b8-2f2ad181d067 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lazy-loading 'fault' on Instance uuid d9d6e198-85f5-488e-8317-d498205f37cc {{(pid=98081) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:40:25.078023 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-1de23a88-bef2-4606-a9b8-2f2ad181d067 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a3efaa75e64645abf7555ccfe348d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b23386679f44b7e9d4204ab1e9adf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:25.088171 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-1de23a88-bef2-4606-a9b8-2f2ad181d067 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] 10.222.0.38 "GET /compute/v2.1/servers/d9d6e198-85f5-488e-8317-d498205f37cc" status: 200 len: 1308 microversion: 2.1 time: 0.236471 Feb 17 04:40:25.088782 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 276/558] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:24 2021] GET /compute/v2.1/servers/d9d6e198-85f5-488e-8317-d498205f37cc => generated 1308 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:40:25.213786 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-31f431a7-0d71-4c12-ac43-848ee561da25 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:25.214782 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-31f431a7-0d71-4c12-ac43-848ee561da25 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:25.223958 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-31f431a7-0d71-4c12-ac43-848ee561da25 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:25.224586 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-31f431a7-0d71-4c12-ac43-848ee561da25 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:25.225440 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-31f431a7-0d71-4c12-ac43-848ee561da25 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:25.225936 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-31f431a7-0d71-4c12-ac43-848ee561da25 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:25.478583 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-31f431a7-0d71-4c12-ac43-848ee561da25 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:25.490861 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-31f431a7-0d71-4c12-ac43-848ee561da25 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:25.492608 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-31f431a7-0d71-4c12-ac43-848ee561da25 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:25.493836 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-31f431a7-0d71-4c12-ac43-848ee561da25 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1810 microversion: 2.20 time: 0.284212 Feb 17 04:40:25.494640 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 283/559] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:40:25 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1810 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:40:26.107305 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-fbe2da14-9350-4e30-a127-01b333253072 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:26.107982 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-fbe2da14-9350-4e30-a127-01b333253072 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] [instance: d9d6e198-85f5-488e-8317-d498205f37cc] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:26.116082 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-fbe2da14-9350-4e30-a127-01b333253072 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:26.116591 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-fbe2da14-9350-4e30-a127-01b333253072 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:26.117455 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-fbe2da14-9350-4e30-a127-01b333253072 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:26.117948 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-fbe2da14-9350-4e30-a127-01b333253072 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:26.197330 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-fbe2da14-9350-4e30-a127-01b333253072 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:26.197759 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-fbe2da14-9350-4e30-a127-01b333253072 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:26.198273 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.objects.instance [None req-fbe2da14-9350-4e30-a127-01b333253072 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lazy-loading 'fault' on Instance uuid d9d6e198-85f5-488e-8317-d498205f37cc {{(pid=98081) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:40:26.267531 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-fbe2da14-9350-4e30-a127-01b333253072 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a3efaa75e64645abf7555ccfe348d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b23386679f44b7e9d4204ab1e9adf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:26.277494 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-fbe2da14-9350-4e30-a127-01b333253072 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] 10.222.0.38 "GET /compute/v2.1/servers/d9d6e198-85f5-488e-8317-d498205f37cc" status: 200 len: 1308 microversion: 2.1 time: 0.174109 Feb 17 04:40:26.278386 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 277/560] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:26 2021] GET /compute/v2.1/servers/d9d6e198-85f5-488e-8317-d498205f37cc => generated 1308 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:40:26.513649 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-0d978678-a480-4d3f-89c5-b904d839de1f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:26.514323 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-0d978678-a480-4d3f-89c5-b904d839de1f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:26.523498 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0d978678-a480-4d3f-89c5-b904d839de1f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:26.524018 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0d978678-a480-4d3f-89c5-b904d839de1f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:26.524871 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0d978678-a480-4d3f-89c5-b904d839de1f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:26.525372 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0d978678-a480-4d3f-89c5-b904d839de1f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:26.746135 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-0d978678-a480-4d3f-89c5-b904d839de1f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:26.757166 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-0d978678-a480-4d3f-89c5-b904d839de1f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:26.758907 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-0d978678-a480-4d3f-89c5-b904d839de1f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:26.760330 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-0d978678-a480-4d3f-89c5-b904d839de1f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1810 microversion: 2.20 time: 0.250665 Feb 17 04:40:26.761130 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 284/561] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:40:26 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1810 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:40:27.297459 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-85eb958b-5583-4502-b8a5-f518d031210e tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:27.298081 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-85eb958b-5583-4502-b8a5-f518d031210e tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] [instance: d9d6e198-85f5-488e-8317-d498205f37cc] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:27.306153 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-85eb958b-5583-4502-b8a5-f518d031210e tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:27.306731 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-85eb958b-5583-4502-b8a5-f518d031210e tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:27.307589 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-85eb958b-5583-4502-b8a5-f518d031210e tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:27.308091 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-85eb958b-5583-4502-b8a5-f518d031210e tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:27.383621 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-85eb958b-5583-4502-b8a5-f518d031210e tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:27.384132 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-85eb958b-5583-4502-b8a5-f518d031210e tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:27.384647 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.objects.instance [None req-85eb958b-5583-4502-b8a5-f518d031210e tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lazy-loading 'fault' on Instance uuid d9d6e198-85f5-488e-8317-d498205f37cc {{(pid=98081) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:40:27.453964 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-85eb958b-5583-4502-b8a5-f518d031210e tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a3efaa75e64645abf7555ccfe348d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b23386679f44b7e9d4204ab1e9adf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:27.463466 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-85eb958b-5583-4502-b8a5-f518d031210e tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] 10.222.0.38 "GET /compute/v2.1/servers/d9d6e198-85f5-488e-8317-d498205f37cc" status: 200 len: 1308 microversion: 2.1 time: 0.170243 Feb 17 04:40:27.464067 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 278/562] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:27 2021] GET /compute/v2.1/servers/d9d6e198-85f5-488e-8317-d498205f37cc => generated 1308 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:40:27.781530 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-7eceb047-3510-4c74-8bd5-2bc214f41c1a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:27.782249 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-7eceb047-3510-4c74-8bd5-2bc214f41c1a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:27.790253 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7eceb047-3510-4c74-8bd5-2bc214f41c1a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:27.790802 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7eceb047-3510-4c74-8bd5-2bc214f41c1a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:27.791644 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7eceb047-3510-4c74-8bd5-2bc214f41c1a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:27.792138 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7eceb047-3510-4c74-8bd5-2bc214f41c1a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:28.004679 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-7eceb047-3510-4c74-8bd5-2bc214f41c1a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:28.016129 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-7eceb047-3510-4c74-8bd5-2bc214f41c1a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:28.017785 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-7eceb047-3510-4c74-8bd5-2bc214f41c1a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:28.019186 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-7eceb047-3510-4c74-8bd5-2bc214f41c1a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1810 microversion: 2.20 time: 0.241733 Feb 17 04:40:28.020389 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 285/563] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:40:27 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1810 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:40:28.483110 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-8e62ddeb-1bea-438b-babb-88b8db808f16 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:28.483785 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-8e62ddeb-1bea-438b-babb-88b8db808f16 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] [instance: d9d6e198-85f5-488e-8317-d498205f37cc] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:28.494351 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8e62ddeb-1bea-438b-babb-88b8db808f16 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:28.495203 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8e62ddeb-1bea-438b-babb-88b8db808f16 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:28.496066 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8e62ddeb-1bea-438b-babb-88b8db808f16 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:28.496567 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8e62ddeb-1bea-438b-babb-88b8db808f16 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:28.577663 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8e62ddeb-1bea-438b-babb-88b8db808f16 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:28.578182 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8e62ddeb-1bea-438b-babb-88b8db808f16 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:28.578723 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.objects.instance [None req-8e62ddeb-1bea-438b-babb-88b8db808f16 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lazy-loading 'fault' on Instance uuid d9d6e198-85f5-488e-8317-d498205f37cc {{(pid=98081) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:40:28.688494 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-8e62ddeb-1bea-438b-babb-88b8db808f16 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a3efaa75e64645abf7555ccfe348d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b23386679f44b7e9d4204ab1e9adf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:28.698609 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-8e62ddeb-1bea-438b-babb-88b8db808f16 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] 10.222.0.38 "GET /compute/v2.1/servers/d9d6e198-85f5-488e-8317-d498205f37cc" status: 200 len: 1308 microversion: 2.1 time: 0.219552 Feb 17 04:40:28.699451 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 279/564] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:28 2021] GET /compute/v2.1/servers/d9d6e198-85f5-488e-8317-d498205f37cc => generated 1308 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:40:29.038996 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-18ea4673-5f9d-4ebb-a84c-5c803dc4e3b2 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:29.039694 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-18ea4673-5f9d-4ebb-a84c-5c803dc4e3b2 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:29.048306 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-18ea4673-5f9d-4ebb-a84c-5c803dc4e3b2 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:29.049253 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-18ea4673-5f9d-4ebb-a84c-5c803dc4e3b2 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:29.050385 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-18ea4673-5f9d-4ebb-a84c-5c803dc4e3b2 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:29.051292 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-18ea4673-5f9d-4ebb-a84c-5c803dc4e3b2 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:29.278641 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-18ea4673-5f9d-4ebb-a84c-5c803dc4e3b2 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:29.289860 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-18ea4673-5f9d-4ebb-a84c-5c803dc4e3b2 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:29.291461 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-18ea4673-5f9d-4ebb-a84c-5c803dc4e3b2 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:29.292663 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-18ea4673-5f9d-4ebb-a84c-5c803dc4e3b2 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1810 microversion: 2.20 time: 0.257960 Feb 17 04:40:29.293248 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 286/565] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:40:29 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1810 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:40:29.573979 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-72bc5eac-4e18-4a97-b61a-eac343ab1c39 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:29.574713 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-72bc5eac-4e18-4a97-b61a-eac343ab1c39 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] [instance: 9231f663-c4c6-4723-8d42-377d3f6dd031] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:29.582882 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-72bc5eac-4e18-4a97-b61a-eac343ab1c39 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:29.583413 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-72bc5eac-4e18-4a97-b61a-eac343ab1c39 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:29.584264 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-72bc5eac-4e18-4a97-b61a-eac343ab1c39 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:29.584765 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-72bc5eac-4e18-4a97-b61a-eac343ab1c39 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:29.717683 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-d3252375-15ac-48fe-9b9f-79b1f4fde2dd tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:29.718355 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-d3252375-15ac-48fe-9b9f-79b1f4fde2dd tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] [instance: d9d6e198-85f5-488e-8317-d498205f37cc] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:29.726953 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d3252375-15ac-48fe-9b9f-79b1f4fde2dd tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:29.727467 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d3252375-15ac-48fe-9b9f-79b1f4fde2dd tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:29.728757 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d3252375-15ac-48fe-9b9f-79b1f4fde2dd tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:29.729312 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d3252375-15ac-48fe-9b9f-79b1f4fde2dd tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:29.787645 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.wsgi [None req-d3252375-15ac-48fe-9b9f-79b1f4fde2dd tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] HTTP exception thrown: Instance d9d6e198-85f5-488e-8317-d498205f37cc could not be found. Feb 17 04:40:29.788240 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-d3252375-15ac-48fe-9b9f-79b1f4fde2dd tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Returning 404 to user: Instance d9d6e198-85f5-488e-8317-d498205f37cc could not be found. {{(pid=98080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:40:29.789164 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-d3252375-15ac-48fe-9b9f-79b1f4fde2dd tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] 10.222.0.38 "GET /compute/v2.1/servers/d9d6e198-85f5-488e-8317-d498205f37cc" status: 404 len: 111 microversion: 2.1 time: 0.076574 Feb 17 04:40:29.793840 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 287/566] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:29 2021] GET /compute/v2.1/servers/d9d6e198-85f5-488e-8317-d498205f37cc => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:40:29.822548 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-72bc5eac-4e18-4a97-b61a-eac343ab1c39 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190727a0bed54b52913aa6aa1ff8cea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57600d4d269474ab7d2f3e7ebf528ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:29.835367 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-72bc5eac-4e18-4a97-b61a-eac343ab1c39 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] 10.222.0.38 "GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031" status: 200 len: 1592 microversion: 2.1 time: 0.265370 Feb 17 04:40:29.836079 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 280/567] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:29 2021] GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031 => generated 1592 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:40:29.853580 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-4e203798-eb91-43a6-a62c-aeffa7b24363 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Action: 'create', calling method: .version_select at 0x7fc2e96bf8c8>, body: {"pool": null} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:40:30.315272 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-b01ed0d9-d230-4629-bb23-3f1bf5feb5db tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:30.315860 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-b01ed0d9-d230-4629-bb23-3f1bf5feb5db tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:30.324495 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b01ed0d9-d230-4629-bb23-3f1bf5feb5db tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:30.324999 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b01ed0d9-d230-4629-bb23-3f1bf5feb5db tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:30.325831 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b01ed0d9-d230-4629-bb23-3f1bf5feb5db tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:30.326320 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b01ed0d9-d230-4629-bb23-3f1bf5feb5db tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:30.711691 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-b01ed0d9-d230-4629-bb23-3f1bf5feb5db tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:30.721536 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-b01ed0d9-d230-4629-bb23-3f1bf5feb5db tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:30.723642 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-b01ed0d9-d230-4629-bb23-3f1bf5feb5db tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:30.724951 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-b01ed0d9-d230-4629-bb23-3f1bf5feb5db tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1810 microversion: 2.20 time: 0.413855 Feb 17 04:40:30.725546 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 281/568] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:40:30 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1810 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 04:40:31.744946 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-5ceceb23-d0d2-4c1a-883a-8863d81332ca tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:31.745736 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-5ceceb23-d0d2-4c1a-883a-8863d81332ca tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:31.753781 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5ceceb23-d0d2-4c1a-883a-8863d81332ca tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:31.754964 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5ceceb23-d0d2-4c1a-883a-8863d81332ca tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:31.755827 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5ceceb23-d0d2-4c1a-883a-8863d81332ca tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:31.756335 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5ceceb23-d0d2-4c1a-883a-8863d81332ca tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:32.131317 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-5ceceb23-d0d2-4c1a-883a-8863d81332ca tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:32.141524 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-5ceceb23-d0d2-4c1a-883a-8863d81332ca tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:32.143108 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-5ceceb23-d0d2-4c1a-883a-8863d81332ca tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:32.144296 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-5ceceb23-d0d2-4c1a-883a-8863d81332ca tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1810 microversion: 2.20 time: 0.403400 Feb 17 04:40:32.144927 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 282/569] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:40:31 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1810 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 04:40:32.335913 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-4e203798-eb91-43a6-a62c-aeffa7b24363 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] 10.222.0.38 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.486194 Feb 17 04:40:32.336548 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 288/570] 10.222.0.38 () {60 vars in 1160 bytes} [Wed Feb 17 04:40:29 2021] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2488 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:40:32.348650 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-8b959d3e-2845-4ad2-8266-084b7f410aa7 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Action: 'action', calling method: .version_select at 0x7fc2eb636ae8>, body: {"addFloatingIp": {"address": "172.27.0.111"}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:40:32.349924 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-8b959d3e-2845-4ad2-8266-084b7f410aa7 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] [instance: 9231f663-c4c6-4723-8d42-377d3f6dd031] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:32.357847 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8b959d3e-2845-4ad2-8266-084b7f410aa7 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:32.358350 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8b959d3e-2845-4ad2-8266-084b7f410aa7 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:32.359214 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8b959d3e-2845-4ad2-8266-084b7f410aa7 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:32.359707 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8b959d3e-2845-4ad2-8266-084b7f410aa7 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:32.424403 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8b959d3e-2845-4ad2-8266-084b7f410aa7 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Acquired lock "refresh_cache-9231f663-c4c6-4723-8d42-377d3f6dd031" {{(pid=98081) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Feb 17 04:40:33.164380 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-81fb3521-81f3-4142-a023-065e02b7e744 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:33.165161 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-81fb3521-81f3-4142-a023-065e02b7e744 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:33.173491 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-81fb3521-81f3-4142-a023-065e02b7e744 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:33.173999 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-81fb3521-81f3-4142-a023-065e02b7e744 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:33.174913 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-81fb3521-81f3-4142-a023-065e02b7e744 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:33.175414 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-81fb3521-81f3-4142-a023-065e02b7e744 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:33.763657 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-81fb3521-81f3-4142-a023-065e02b7e744 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:33.774778 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-81fb3521-81f3-4142-a023-065e02b7e744 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:33.776332 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-81fb3521-81f3-4142-a023-065e02b7e744 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:33.777745 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-81fb3521-81f3-4142-a023-065e02b7e744 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1810 microversion: 2.20 time: 0.617422 Feb 17 04:40:33.778499 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 289/571] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:40:33 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1810 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 04:40:34.434660 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-000902a5-16be-4219-a1b3-5318756cf2bc tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:34.435284 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-000902a5-16be-4219-a1b3-5318756cf2bc tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: b5217ba8-1c7d-4811-bc6f-daeedd5d8d02] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:34.444557 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-000902a5-16be-4219-a1b3-5318756cf2bc tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:34.445481 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-000902a5-16be-4219-a1b3-5318756cf2bc tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:34.447079 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-000902a5-16be-4219-a1b3-5318756cf2bc tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:34.447993 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-000902a5-16be-4219-a1b3-5318756cf2bc tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:34.511007 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.network.neutron [None req-8b959d3e-2845-4ad2-8266-084b7f410aa7 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] [instance: 9231f663-c4c6-4723-8d42-377d3f6dd031] Building network info cache for instance {{(pid=98081) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1836}} Feb 17 04:40:34.533493 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-000902a5-16be-4219-a1b3-5318756cf2bc tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: b5217ba8-1c7d-4811-bc6f-daeedd5d8d02] Going to try to terminate instance {{(pid=98080) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 04:40:34.677905 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-000902a5-16be-4219-a1b3-5318756cf2bc tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "DELETE /compute/v2.1/servers/b5217ba8-1c7d-4811-bc6f-daeedd5d8d02" status: 204 len: 0 microversion: 2.1 time: 0.246755 Feb 17 04:40:34.682200 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 290/572] 10.222.0.38 () {58 vars in 1229 bytes} [Wed Feb 17 04:40:34 2021] DELETE /compute/v2.1/servers/b5217ba8-1c7d-4811-bc6f-daeedd5d8d02 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 17 04:40:34.688760 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [req-ab7a5b7e-704f-4138-96b2-62b3b1a5105f req-c053c4e0-d805-44c9-9453-9cbe7c0f6f87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9231f663-c4c6-4723-8d42-377d3f6dd031", "tag": "8c40a9f8-0504-4483-9e26-48a5210a4191"}]} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:40:34.690747 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:40:34.690747 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:40:34.700779 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-ab7a5b7e-704f-4138-96b2-62b3b1a5105f req-c053c4e0-d805-44c9-9453-9cbe7c0f6f87 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:34.701282 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-ab7a5b7e-704f-4138-96b2-62b3b1a5105f req-c053c4e0-d805-44c9-9453-9cbe7c0f6f87 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:34.720841 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.compute.server_external_events [req-ab7a5b7e-704f-4138-96b2-62b3b1a5105f req-c053c4e0-d805-44c9-9453-9cbe7c0f6f87 service nova] Creating event network-changed:8c40a9f8-0504-4483-9e26-48a5210a4191 for instance 9231f663-c4c6-4723-8d42-377d3f6dd031 on hv-cinder-76019 Feb 17 04:40:34.726988 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [req-ab7a5b7e-704f-4138-96b2-62b3b1a5105f req-c053c4e0-d805-44c9-9453-9cbe7c0f6f87 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045606 Feb 17 04:40:34.728130 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 291/573] 10.222.0.38 () {64 vars in 1308 bytes} [Wed Feb 17 04:40:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:40:34.733701 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-74610bc8-3312-4bef-9f58-90e0d42f261d tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:34.734473 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-74610bc8-3312-4bef-9f58-90e0d42f261d tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: b5217ba8-1c7d-4811-bc6f-daeedd5d8d02] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:34.745101 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-74610bc8-3312-4bef-9f58-90e0d42f261d tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:34.745627 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-74610bc8-3312-4bef-9f58-90e0d42f261d tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:34.746492 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-74610bc8-3312-4bef-9f58-90e0d42f261d tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:34.747029 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-74610bc8-3312-4bef-9f58-90e0d42f261d tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:35.372709 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-74610bc8-3312-4bef-9f58-90e0d42f261d tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a46d18160148f3a48ef4887f6ec7da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6284f2b80524eb0a36ccebaedba767a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:35.382977 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-74610bc8-3312-4bef-9f58-90e0d42f261d tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "GET /compute/v2.1/servers/b5217ba8-1c7d-4811-bc6f-daeedd5d8d02" status: 200 len: 1514 microversion: 2.1 time: 0.653181 Feb 17 04:40:35.386768 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 292/574] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:34 2021] GET /compute/v2.1/servers/b5217ba8-1c7d-4811-bc6f-daeedd5d8d02 => generated 1514 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:40:35.391509 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-89ed9c5d-43d6-490e-ac30-2f2705ff5775 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:35.392316 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-89ed9c5d-43d6-490e-ac30-2f2705ff5775 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:35.400936 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-89ed9c5d-43d6-490e-ac30-2f2705ff5775 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:35.401584 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-89ed9c5d-43d6-490e-ac30-2f2705ff5775 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:35.402500 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-89ed9c5d-43d6-490e-ac30-2f2705ff5775 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:35.403095 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-89ed9c5d-43d6-490e-ac30-2f2705ff5775 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:35.938736 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-89ed9c5d-43d6-490e-ac30-2f2705ff5775 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:35.957585 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-89ed9c5d-43d6-490e-ac30-2f2705ff5775 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:35.958995 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-89ed9c5d-43d6-490e-ac30-2f2705ff5775 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:35.960303 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-89ed9c5d-43d6-490e-ac30-2f2705ff5775 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1810 microversion: 2.20 time: 0.575671 Feb 17 04:40:35.969900 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 293/575] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:40:35 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1810 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:40:36.268602 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.network.neutron [None req-8b959d3e-2845-4ad2-8266-084b7f410aa7 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] [instance: 9231f663-c4c6-4723-8d42-377d3f6dd031] Updating instance_info_cache with network_info: [{"id": "8c40a9f8-0504-4483-9e26-48a5210a4191", "address": "fa:16:3e:ad:b8:06", "network": {"id": "6867f3e4-ec3d-45b2-9435-bb5e12342eb7", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-218432083-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.27.0.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "e57600d4d269474ab7d2f3e7ebf528ac", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tap8c40a9f8-05", "ovs_interfaceid": "8c40a9f8-0504-4483-9e26-48a5210a4191", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=98081) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Feb 17 04:40:36.287715 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8b959d3e-2845-4ad2-8266-084b7f410aa7 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Releasing lock "refresh_cache-9231f663-c4c6-4723-8d42-377d3f6dd031" {{(pid=98081) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Feb 17 04:40:36.289860 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-8b959d3e-2845-4ad2-8266-084b7f410aa7 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] 10.222.0.38 "POST /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031/action" status: 202 len: 0 microversion: 2.1 time: 3.945644 Feb 17 04:40:36.290908 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 283/576] 10.222.0.38 () {60 vars in 1268 bytes} [Wed Feb 17 04:40:32 2021] POST /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031/action => generated 0 bytes in 3947 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Feb 17 04:40:36.299389 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-47e99f27-13ca-41ba-8919-a72cd87f8929 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Action: 'create', calling method: .version_select at 0x7fc2e974bbf8>, body: {"security_group": {"name": "tempest-TestMinimumBasicScenario-1389943885", "description": "tempest-TestMinimumBasicScenario-1389943885 description"}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:40:36.401121 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-c14972c4-cd66-4eb4-a660-9dd14bc20579 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:36.402098 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-c14972c4-cd66-4eb4-a660-9dd14bc20579 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: b5217ba8-1c7d-4811-bc6f-daeedd5d8d02] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:36.411154 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c14972c4-cd66-4eb4-a660-9dd14bc20579 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:36.411936 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c14972c4-cd66-4eb4-a660-9dd14bc20579 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:36.413011 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c14972c4-cd66-4eb4-a660-9dd14bc20579 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:36.413694 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c14972c4-cd66-4eb4-a660-9dd14bc20579 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:36.720478 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-c14972c4-cd66-4eb4-a660-9dd14bc20579 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a46d18160148f3a48ef4887f6ec7da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6284f2b80524eb0a36ccebaedba767a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:36.730290 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-c14972c4-cd66-4eb4-a660-9dd14bc20579 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "GET /compute/v2.1/servers/b5217ba8-1c7d-4811-bc6f-daeedd5d8d02" status: 200 len: 1514 microversion: 2.1 time: 0.333124 Feb 17 04:40:36.730961 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 284/577] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:36 2021] GET /compute/v2.1/servers/b5217ba8-1c7d-4811-bc6f-daeedd5d8d02 => generated 1514 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:40:36.763638 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-47e99f27-13ca-41ba-8919-a72cd87f8929 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] 10.222.0.38 "POST /compute/v2.1/os-security-groups" status: 200 len: 257 microversion: 2.1 time: 0.468255 Feb 17 04:40:36.764236 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 294/578] 10.222.0.38 () {60 vars in 1170 bytes} [Wed Feb 17 04:40:36 2021] POST /compute/v2.1/os-security-groups => generated 257 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:40:36.776247 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-93a77dc5-91b2-4a40-8248-86995d58c5f4 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Action: 'create', calling method: .version_select at 0x7fc2e9d27268>, body: {"security_group_rule": {"parent_group_id": "982665c9-67b2-41e8-a6c8-2cc22a829360", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "0.0.0.0/0"}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:40:36.993448 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-7b39a64c-44d9-4528-a934-f4b89ec18426 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:36.994121 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-7b39a64c-44d9-4528-a934-f4b89ec18426 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:36.994938 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-93a77dc5-91b2-4a40-8248-86995d58c5f4 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] 10.222.0.38 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.222522 Feb 17 04:40:36.995582 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 285/579] 10.222.0.38 () {60 vars in 1185 bytes} [Wed Feb 17 04:40:36 2021] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:40:37.005710 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7b39a64c-44d9-4528-a934-f4b89ec18426 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:37.006221 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7b39a64c-44d9-4528-a934-f4b89ec18426 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:37.007095 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7b39a64c-44d9-4528-a934-f4b89ec18426 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:37.007584 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7b39a64c-44d9-4528-a934-f4b89ec18426 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:37.007935 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-b4b768f5-7344-474f-ad8a-37a5dcaef9a8 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Action: 'create', calling method: .version_select at 0x7fc2e9d5b510>, body: {"security_group_rule": {"parent_group_id": "982665c9-67b2-41e8-a6c8-2cc22a829360", "ip_protocol": "icmp", "from_port": -1, "to_port": -1, "cidr": "0.0.0.0/0"}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:40:37.479080 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-7b39a64c-44d9-4528-a934-f4b89ec18426 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:37.490185 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-7b39a64c-44d9-4528-a934-f4b89ec18426 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:37.491827 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-7b39a64c-44d9-4528-a934-f4b89ec18426 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:37.492908 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-7b39a64c-44d9-4528-a934-f4b89ec18426 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1810 microversion: 2.20 time: 0.505093 Feb 17 04:40:37.493713 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 295/580] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:40:36 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1810 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:40:37.556877 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-b4b768f5-7344-474f-ad8a-37a5dcaef9a8 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] 10.222.0.38 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.554107 Feb 17 04:40:37.557927 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 286/581] 10.222.0.38 () {60 vars in 1185 bytes} [Wed Feb 17 04:40:37 2021] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:40:37.569008 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-c0215faf-4a92-426d-b382-c883fa46cf58 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-TestMinimumBasicScenario-1389943885"}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:40:37.569606 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-c0215faf-4a92-426d-b382-c883fa46cf58 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] [instance: 9231f663-c4c6-4723-8d42-377d3f6dd031] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:37.577828 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c0215faf-4a92-426d-b382-c883fa46cf58 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:37.578338 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c0215faf-4a92-426d-b382-c883fa46cf58 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:37.579211 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c0215faf-4a92-426d-b382-c883fa46cf58 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:37.579713 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c0215faf-4a92-426d-b382-c883fa46cf58 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:37.749043 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-7b0f9054-624d-46fd-8e1b-874234bb526e tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:37.749721 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-7b0f9054-624d-46fd-8e1b-874234bb526e tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: b5217ba8-1c7d-4811-bc6f-daeedd5d8d02] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:37.758321 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7b0f9054-624d-46fd-8e1b-874234bb526e tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:37.758878 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7b0f9054-624d-46fd-8e1b-874234bb526e tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:37.759741 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7b0f9054-624d-46fd-8e1b-874234bb526e tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:37.760242 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7b0f9054-624d-46fd-8e1b-874234bb526e tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:37.801113 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.network.security_group_api [None req-c0215faf-4a92-426d-b382-c883fa46cf58 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Adding security group 982665c9-67b2-41e8-a6c8-2cc22a829360 to port 8c40a9f8-0504-4483-9e26-48a5210a4191 Feb 17 04:40:38.170535 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-7b0f9054-624d-46fd-8e1b-874234bb526e tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a46d18160148f3a48ef4887f6ec7da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6284f2b80524eb0a36ccebaedba767a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:38.180167 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-7b0f9054-624d-46fd-8e1b-874234bb526e tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "GET /compute/v2.1/servers/b5217ba8-1c7d-4811-bc6f-daeedd5d8d02" status: 200 len: 1514 microversion: 2.1 time: 0.435027 Feb 17 04:40:38.180855 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 287/582] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:37 2021] GET /compute/v2.1/servers/b5217ba8-1c7d-4811-bc6f-daeedd5d8d02 => generated 1514 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:40:38.512139 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-f777dfa0-b19f-429f-86dc-4b0d92aa3586 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:38.512895 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-f777dfa0-b19f-429f-86dc-4b0d92aa3586 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:38.521321 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f777dfa0-b19f-429f-86dc-4b0d92aa3586 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:38.521834 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f777dfa0-b19f-429f-86dc-4b0d92aa3586 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:38.522740 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f777dfa0-b19f-429f-86dc-4b0d92aa3586 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:38.523239 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f777dfa0-b19f-429f-86dc-4b0d92aa3586 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:38.697816 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-c0215faf-4a92-426d-b382-c883fa46cf58 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] 10.222.0.38 "POST /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031/action" status: 202 len: 0 microversion: 2.1 time: 1.132758 Feb 17 04:40:38.698588 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 296/583] 10.222.0.38 () {60 vars in 1268 bytes} [Wed Feb 17 04:40:37 2021] POST /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031/action => generated 0 bytes in 1134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:40:38.707440 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [req-682342f4-efca-449f-bbae-8facc5069ab8 req-f64875c4-3491-4ad8-80af-2f3a293ce88c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9231f663-c4c6-4723-8d42-377d3f6dd031", "tag": "8c40a9f8-0504-4483-9e26-48a5210a4191"}]} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:40:38.709411 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:40:38.709411 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:40:38.718769 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-682342f4-efca-449f-bbae-8facc5069ab8 req-f64875c4-3491-4ad8-80af-2f3a293ce88c service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:38.719278 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-682342f4-efca-449f-bbae-8facc5069ab8 req-f64875c4-3491-4ad8-80af-2f3a293ce88c service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:38.739733 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.compute.server_external_events [req-682342f4-efca-449f-bbae-8facc5069ab8 req-f64875c4-3491-4ad8-80af-2f3a293ce88c service nova] Creating event network-changed:8c40a9f8-0504-4483-9e26-48a5210a4191 for instance 9231f663-c4c6-4723-8d42-377d3f6dd031 on hv-cinder-76019 Feb 17 04:40:38.744973 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [req-682342f4-efca-449f-bbae-8facc5069ab8 req-f64875c4-3491-4ad8-80af-2f3a293ce88c service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041447 Feb 17 04:40:38.745933 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 297/584] 10.222.0.38 () {64 vars in 1308 bytes} [Wed Feb 17 04:40:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:40:38.751537 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-4c91614f-ef99-4f07-a311-ab7e0cd935d3 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:38.752314 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-4c91614f-ef99-4f07-a311-ab7e0cd935d3 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] [instance: 9231f663-c4c6-4723-8d42-377d3f6dd031] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:38.761009 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4c91614f-ef99-4f07-a311-ab7e0cd935d3 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:38.761710 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4c91614f-ef99-4f07-a311-ab7e0cd935d3 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:38.762621 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4c91614f-ef99-4f07-a311-ab7e0cd935d3 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:38.763087 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4c91614f-ef99-4f07-a311-ab7e0cd935d3 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:38.789713 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-f777dfa0-b19f-429f-86dc-4b0d92aa3586 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:38.800311 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-f777dfa0-b19f-429f-86dc-4b0d92aa3586 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:38.802469 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-f777dfa0-b19f-429f-86dc-4b0d92aa3586 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:38.803812 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-f777dfa0-b19f-429f-86dc-4b0d92aa3586 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1810 microversion: 2.20 time: 0.295751 Feb 17 04:40:38.804478 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 288/585] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:40:38 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1810 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 04:40:38.987243 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-4c91614f-ef99-4f07-a311-ab7e0cd935d3 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190727a0bed54b52913aa6aa1ff8cea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57600d4d269474ab7d2f3e7ebf528ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:38.997867 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-4c91614f-ef99-4f07-a311-ab7e0cd935d3 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] 10.222.0.38 "GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031" status: 200 len: 1768 microversion: 2.1 time: 0.250662 Feb 17 04:40:38.998744 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 298/586] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:38 2021] GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031 => generated 1768 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:40:39.198790 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-d94c4160-9660-4f2e-8da2-5510809cfa4e tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:39.200161 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-d94c4160-9660-4f2e-8da2-5510809cfa4e tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: b5217ba8-1c7d-4811-bc6f-daeedd5d8d02] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:39.208226 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d94c4160-9660-4f2e-8da2-5510809cfa4e tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:39.208736 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d94c4160-9660-4f2e-8da2-5510809cfa4e tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:39.209591 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d94c4160-9660-4f2e-8da2-5510809cfa4e tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:39.210089 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d94c4160-9660-4f2e-8da2-5510809cfa4e tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:39.603938 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-d94c4160-9660-4f2e-8da2-5510809cfa4e tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a46d18160148f3a48ef4887f6ec7da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6284f2b80524eb0a36ccebaedba767a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:39.612903 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-d94c4160-9660-4f2e-8da2-5510809cfa4e tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "GET /compute/v2.1/servers/b5217ba8-1c7d-4811-bc6f-daeedd5d8d02" status: 200 len: 1514 microversion: 2.1 time: 0.418234 Feb 17 04:40:39.613569 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 289/587] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:39 2021] GET /compute/v2.1/servers/b5217ba8-1c7d-4811-bc6f-daeedd5d8d02 => generated 1514 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:40:39.741870 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-c8db9bd3-767a-4787-a110-610d5205f8b9 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:39.742416 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-c8db9bd3-767a-4787-a110-610d5205f8b9 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 1c099afc-d941-4044-83cc-39185d6d57b0] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:39.750113 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c8db9bd3-767a-4787-a110-610d5205f8b9 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:39.750647 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c8db9bd3-767a-4787-a110-610d5205f8b9 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:39.751569 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c8db9bd3-767a-4787-a110-610d5205f8b9 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:39.751980 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c8db9bd3-767a-4787-a110-610d5205f8b9 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:39.818836 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-c8db9bd3-767a-4787-a110-610d5205f8b9 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 1c099afc-d941-4044-83cc-39185d6d57b0] Going to try to terminate instance {{(pid=98080) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 04:40:39.823842 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-fd2a2b70-53d9-4cca-9170-1ed93d263981 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:39.824522 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-fd2a2b70-53d9-4cca-9170-1ed93d263981 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:39.833081 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-fd2a2b70-53d9-4cca-9170-1ed93d263981 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:39.833597 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-fd2a2b70-53d9-4cca-9170-1ed93d263981 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:39.834454 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-fd2a2b70-53d9-4cca-9170-1ed93d263981 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:39.834986 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-fd2a2b70-53d9-4cca-9170-1ed93d263981 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:39.944503 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-c8db9bd3-767a-4787-a110-610d5205f8b9 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "DELETE /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0" status: 204 len: 0 microversion: 2.1 time: 0.207197 Feb 17 04:40:39.948152 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 299/588] 10.222.0.38 () {58 vars in 1229 bytes} [Wed Feb 17 04:40:39 2021] DELETE /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 17 04:40:39.957328 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-897bf1f6-300e-4106-8bea-9686a8b32703 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:39.958553 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-897bf1f6-300e-4106-8bea-9686a8b32703 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 1c099afc-d941-4044-83cc-39185d6d57b0] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:39.967562 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-897bf1f6-300e-4106-8bea-9686a8b32703 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:39.968167 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-897bf1f6-300e-4106-8bea-9686a8b32703 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:39.969389 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-897bf1f6-300e-4106-8bea-9686a8b32703 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:39.969904 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-897bf1f6-300e-4106-8bea-9686a8b32703 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:40.749034 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-fd2a2b70-53d9-4cca-9170-1ed93d263981 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:40.760514 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-fd2a2b70-53d9-4cca-9170-1ed93d263981 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:40.768362 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-fd2a2b70-53d9-4cca-9170-1ed93d263981 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:40.770334 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-fd2a2b70-53d9-4cca-9170-1ed93d263981 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1810 microversion: 2.20 time: 0.950665 Feb 17 04:40:40.771436 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 290/589] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:40:39 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1810 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:40:40.776446 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-d90d598c-6f68-4aa5-8416-253f94f91690 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2130418517", "imageRef": "2d6991a7-a1f0-444b-8fd5-d05558b5f9a4", "flavorRef": "452", "networks": [{"uuid": "58123a5b-89a3-47b4-8bcf-bc477b9c807f"}]}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:40:40.861897 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.network.neutron [None req-d90d598c-6f68-4aa5-8416-253f94f91690 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] validate_networks() for [('58123a5b-89a3-47b4-8bcf-bc477b9c807f', None, None, None)] {{(pid=98081) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 04:40:40.881568 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-897bf1f6-300e-4106-8bea-9686a8b32703 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:40.890393 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-897bf1f6-300e-4106-8bea-9686a8b32703 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0" status: 200 len: 1507 microversion: 2.1 time: 0.938462 Feb 17 04:40:40.891084 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 300/590] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:39 2021] GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0 => generated 1507 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:40:40.904285 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-c8dd5d76-1d30-49fc-aef9-a0063e03f68f tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:40.904950 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-c8dd5d76-1d30-49fc-aef9-a0063e03f68f tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: b5217ba8-1c7d-4811-bc6f-daeedd5d8d02] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:40.913049 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c8dd5d76-1d30-49fc-aef9-a0063e03f68f tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:40.913558 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c8dd5d76-1d30-49fc-aef9-a0063e03f68f tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:40.914408 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c8dd5d76-1d30-49fc-aef9-a0063e03f68f tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:40.914952 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c8dd5d76-1d30-49fc-aef9-a0063e03f68f tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:41.586813 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-c8dd5d76-1d30-49fc-aef9-a0063e03f68f tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a46d18160148f3a48ef4887f6ec7da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6284f2b80524eb0a36ccebaedba767a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:41.596138 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-c8dd5d76-1d30-49fc-aef9-a0063e03f68f tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "GET /compute/v2.1/servers/b5217ba8-1c7d-4811-bc6f-daeedd5d8d02" status: 200 len: 1514 microversion: 2.1 time: 0.695668 Feb 17 04:40:41.606843 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 301/591] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:40 2021] GET /compute/v2.1/servers/b5217ba8-1c7d-4811-bc6f-daeedd5d8d02 => generated 1514 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:40:41.606843 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [req-01c7277f-e560-4b91-be99-af792abd9d27 req-cadd3149-f07e-40a4-a028-6f8707ac3bc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d9c77fb-c4b1-4b48-a00a-b85af63c8920", "name": "network-vif-plugged", "status": "completed", "tag": "f8a409c8-c8d0-47e0-b35c-7b5830e57e6e"}]} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:40:41.606843 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:40:41.606843 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:40:41.615422 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-01c7277f-e560-4b91-be99-af792abd9d27 req-cadd3149-f07e-40a4-a028-6f8707ac3bc4 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:41.616010 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-01c7277f-e560-4b91-be99-af792abd9d27 req-cadd3149-f07e-40a4-a028-6f8707ac3bc4 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:41.634353 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.compute.server_external_events [req-01c7277f-e560-4b91-be99-af792abd9d27 req-cadd3149-f07e-40a4-a028-6f8707ac3bc4 service nova] Creating event network-vif-plugged:f8a409c8-c8d0-47e0-b35c-7b5830e57e6e for instance 8d9c77fb-c4b1-4b48-a00a-b85af63c8920 on hv-cinder-76019 Feb 17 04:40:41.639278 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [req-01c7277f-e560-4b91-be99-af792abd9d27 req-cadd3149-f07e-40a4-a028-6f8707ac3bc4 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041122 Feb 17 04:40:41.639936 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 302/592] 10.222.0.38 () {64 vars in 1308 bytes} [Wed Feb 17 04:40:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:40:41.790703 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-7a6c071b-f49e-4a48-90b1-3e0e9ad47a7a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:41.791560 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-7a6c071b-f49e-4a48-90b1-3e0e9ad47a7a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:41.799644 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7a6c071b-f49e-4a48-90b1-3e0e9ad47a7a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:41.800157 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7a6c071b-f49e-4a48-90b1-3e0e9ad47a7a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:41.801578 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7a6c071b-f49e-4a48-90b1-3e0e9ad47a7a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:41.802204 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7a6c071b-f49e-4a48-90b1-3e0e9ad47a7a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:42.074210 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-d90d598c-6f68-4aa5-8416-253f94f91690 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Flavor limits 0:0:0 {{(pid=98081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 04:40:42.075556 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-d90d598c-6f68-4aa5-8416-253f94f91690 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Image limits 0:0:0 {{(pid=98081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 04:40:42.076437 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-d90d598c-6f68-4aa5-8416-253f94f91690 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Flavor pref 0:0:0 {{(pid=98081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 04:40:42.077245 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-d90d598c-6f68-4aa5-8416-253f94f91690 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Image pref 0:0:0 {{(pid=98081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 04:40:42.078371 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-d90d598c-6f68-4aa5-8416-253f94f91690 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 04:40:42.091162 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d90d598c-6f68-4aa5-8416-253f94f91690 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:42.091893 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d90d598c-6f68-4aa5-8416-253f94f91690 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:42.092784 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d90d598c-6f68-4aa5-8416-253f94f91690 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:42.093265 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d90d598c-6f68-4aa5-8416-253f94f91690 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:42.115675 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.quota [None req-d90d598c-6f68-4aa5-8416-253f94f91690 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Getting quotas for project 8b23386679f44b7e9d4204ab1e9adf0a. Resources: {'instances', 'cores', 'ram'} {{(pid=98081) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:40:42.121146 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.quota [None req-d90d598c-6f68-4aa5-8416-253f94f91690 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Getting quotas for user d9a3efaa75e64645abf7555ccfe348d5 and project 8b23386679f44b7e9d4204ab1e9adf0a. Resources: {'instances', 'cores', 'ram'} {{(pid=98081) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:40:42.133493 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-d90d598c-6f68-4aa5-8416-253f94f91690 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Going to run 1 instances... {{(pid=98081) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 04:40:42.136435 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-d90d598c-6f68-4aa5-8416-253f94f91690 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] [instance: 34275f2e-8b70-44f1-826d-bff0192f8438] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d6991a7-a1f0-444b-8fd5-d05558b5f9a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98081) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 04:40:42.141932 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-7a6c071b-f49e-4a48-90b1-3e0e9ad47a7a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:42.154330 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-7a6c071b-f49e-4a48-90b1-3e0e9ad47a7a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:42.156755 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-7a6c071b-f49e-4a48-90b1-3e0e9ad47a7a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:42.157941 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-7a6c071b-f49e-4a48-90b1-3e0e9ad47a7a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1810 microversion: 2.20 time: 0.371808 Feb 17 04:40:42.158735 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 303/593] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:40:41 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1810 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 04:40:42.169501 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-1d0e62d1-349c-4a31-9e6b-3ff4b32a81f5 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:42.170443 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-1d0e62d1-349c-4a31-9e6b-3ff4b32a81f5 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 1c099afc-d941-4044-83cc-39185d6d57b0] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:42.195669 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-d90d598c-6f68-4aa5-8416-253f94f91690 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] 10.222.0.38 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.422836 Feb 17 04:40:42.196875 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 291/594] 10.222.0.38 () {60 vars in 1137 bytes} [Wed Feb 17 04:40:40 2021] POST /compute/v2.1/servers => generated 380 bytes in 1425 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 17 04:40:42.201919 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [req-189974bd-41e0-4cc2-85d9-dd094ea26382 req-9763a3c4-6d5f-4740-98bd-d74219e8bd93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5217ba8-1c7d-4811-bc6f-daeedd5d8d02", "name": "network-vif-deleted", "tag": "9a1fe4fe-80c8-4bb9-aef0-db5351e50d39"}]} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:40:42.203919 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:40:42.203919 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:40:42.209641 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1d0e62d1-349c-4a31-9e6b-3ff4b32a81f5 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:42.210095 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1d0e62d1-349c-4a31-9e6b-3ff4b32a81f5 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:42.211276 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1d0e62d1-349c-4a31-9e6b-3ff4b32a81f5 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:42.211785 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1d0e62d1-349c-4a31-9e6b-3ff4b32a81f5 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:42.225189 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-189974bd-41e0-4cc2-85d9-dd094ea26382 req-9763a3c4-6d5f-4740-98bd-d74219e8bd93 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:42.225932 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-189974bd-41e0-4cc2-85d9-dd094ea26382 req-9763a3c4-6d5f-4740-98bd-d74219e8bd93 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:42.249565 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.compute.server_external_events [req-189974bd-41e0-4cc2-85d9-dd094ea26382 req-9763a3c4-6d5f-4740-98bd-d74219e8bd93 service nova] Creating event network-vif-deleted:9a1fe4fe-80c8-4bb9-aef0-db5351e50d39 for instance b5217ba8-1c7d-4811-bc6f-daeedd5d8d02 on hv-cinder-76019 Feb 17 04:40:42.256806 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [req-189974bd-41e0-4cc2-85d9-dd094ea26382 req-9763a3c4-6d5f-4740-98bd-d74219e8bd93 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058378 Feb 17 04:40:42.257603 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 292/595] 10.222.0.38 () {64 vars in 1308 bytes} [Wed Feb 17 04:40:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:40:42.263517 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-c21abde3-c23c-4a5b-a673-a0916ed1f082 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:42.264290 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-c21abde3-c23c-4a5b-a673-a0916ed1f082 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] [instance: 34275f2e-8b70-44f1-826d-bff0192f8438] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:42.394228 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-c21abde3-c23c-4a5b-a673-a0916ed1f082 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a3efaa75e64645abf7555ccfe348d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b23386679f44b7e9d4204ab1e9adf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:42.402336 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-c21abde3-c23c-4a5b-a673-a0916ed1f082 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] 10.222.0.38 "GET /compute/v2.1/servers/34275f2e-8b70-44f1-826d-bff0192f8438" status: 200 len: 1219 microversion: 2.1 time: 0.143555 Feb 17 04:40:42.403092 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 293/596] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:42 2021] GET /compute/v2.1/servers/34275f2e-8b70-44f1-826d-bff0192f8438 => generated 1219 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:40:42.407757 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-90863c4d-ecf3-404c-8253-4c1bba54593b tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:40:42.409196 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-90863c4d-ecf3-404c-8253-4c1bba54593b tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] [instance: 9231f663-c4c6-4723-8d42-377d3f6dd031] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:42.419500 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-90863c4d-ecf3-404c-8253-4c1bba54593b tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:42.420442 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-90863c4d-ecf3-404c-8253-4c1bba54593b tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:42.421299 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-90863c4d-ecf3-404c-8253-4c1bba54593b tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:42.421798 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-90863c4d-ecf3-404c-8253-4c1bba54593b tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:42.554073 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-1d0e62d1-349c-4a31-9e6b-3ff4b32a81f5 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:42.573029 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-1d0e62d1-349c-4a31-9e6b-3ff4b32a81f5 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0" status: 200 len: 1507 microversion: 2.1 time: 0.407052 Feb 17 04:40:42.573722 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 304/597] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:42 2021] GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0 => generated 1507 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:40:42.587106 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-90863c4d-ecf3-404c-8253-4c1bba54593b tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] 10.222.0.38 "POST /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031/action" status: 202 len: 0 microversion: 2.1 time: 0.182730 Feb 17 04:40:42.587905 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 294/598] 10.222.0.38 () {60 vars in 1268 bytes} [Wed Feb 17 04:40:42 2021] POST /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:40:42.596220 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-49b02707-9141-451e-aecd-94a87311f138 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:42.596906 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-49b02707-9141-451e-aecd-94a87311f138 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] [instance: 9231f663-c4c6-4723-8d42-377d3f6dd031] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:42.605244 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-49b02707-9141-451e-aecd-94a87311f138 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:42.605762 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-49b02707-9141-451e-aecd-94a87311f138 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:42.607126 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-49b02707-9141-451e-aecd-94a87311f138 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:42.607608 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-49b02707-9141-451e-aecd-94a87311f138 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:42.617919 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-eb14b135-f394-4bf7-af21-f4865be593b8 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:42.618790 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-eb14b135-f394-4bf7-af21-f4865be593b8 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: b5217ba8-1c7d-4811-bc6f-daeedd5d8d02] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:42.627122 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-eb14b135-f394-4bf7-af21-f4865be593b8 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:42.627641 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-eb14b135-f394-4bf7-af21-f4865be593b8 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:42.629011 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-eb14b135-f394-4bf7-af21-f4865be593b8 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:42.629506 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-eb14b135-f394-4bf7-af21-f4865be593b8 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:42.711217 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-eb14b135-f394-4bf7-af21-f4865be593b8 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:42.711344 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-eb14b135-f394-4bf7-af21-f4865be593b8 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:42.711821 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.objects.instance [None req-eb14b135-f394-4bf7-af21-f4865be593b8 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lazy-loading 'fault' on Instance uuid b5217ba8-1c7d-4811-bc6f-daeedd5d8d02 {{(pid=98081) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:40:42.923892 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-eb14b135-f394-4bf7-af21-f4865be593b8 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a46d18160148f3a48ef4887f6ec7da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6284f2b80524eb0a36ccebaedba767a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:42.934482 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-eb14b135-f394-4bf7-af21-f4865be593b8 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "GET /compute/v2.1/servers/b5217ba8-1c7d-4811-bc6f-daeedd5d8d02" status: 200 len: 1308 microversion: 2.1 time: 0.321046 Feb 17 04:40:42.935847 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 295/599] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:42 2021] GET /compute/v2.1/servers/b5217ba8-1c7d-4811-bc6f-daeedd5d8d02 => generated 1308 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:40:43.181075 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-3a76b374-3f74-4268-9eb0-4247f1b76033 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:43.181761 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-3a76b374-3f74-4268-9eb0-4247f1b76033 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:43.182538 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-49b02707-9141-451e-aecd-94a87311f138 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190727a0bed54b52913aa6aa1ff8cea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57600d4d269474ab7d2f3e7ebf528ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:43.189918 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-3a76b374-3f74-4268-9eb0-4247f1b76033 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:43.190428 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-3a76b374-3f74-4268-9eb0-4247f1b76033 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:43.191612 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-3a76b374-3f74-4268-9eb0-4247f1b76033 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:43.192077 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-3a76b374-3f74-4268-9eb0-4247f1b76033 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:43.194374 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-49b02707-9141-451e-aecd-94a87311f138 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] 10.222.0.38 "GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031" status: 200 len: 1760 microversion: 2.1 time: 0.601995 Feb 17 04:40:43.195012 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 305/600] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:42 2021] GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031 => generated 1760 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:40:43.421513 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-cc5066d5-a890-432d-8bc4-670dd02eb000 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:43.422156 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-cc5066d5-a890-432d-8bc4-670dd02eb000 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] [instance: 34275f2e-8b70-44f1-826d-bff0192f8438] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:43.432730 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-cc5066d5-a890-432d-8bc4-670dd02eb000 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:43.433424 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-cc5066d5-a890-432d-8bc4-670dd02eb000 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:43.434587 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-cc5066d5-a890-432d-8bc4-670dd02eb000 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:43.435090 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-cc5066d5-a890-432d-8bc4-670dd02eb000 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:43.742967 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-cc5066d5-a890-432d-8bc4-670dd02eb000 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a3efaa75e64645abf7555ccfe348d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b23386679f44b7e9d4204ab1e9adf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:43.751947 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-cc5066d5-a890-432d-8bc4-670dd02eb000 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] 10.222.0.38 "GET /compute/v2.1/servers/34275f2e-8b70-44f1-826d-bff0192f8438" status: 200 len: 1271 microversion: 2.1 time: 0.334534 Feb 17 04:40:43.753053 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 306/601] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:43 2021] GET /compute/v2.1/servers/34275f2e-8b70-44f1-826d-bff0192f8438 => generated 1271 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:40:43.759472 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-2bf30f11-9be8-45a0-8025-ffacb04ea431 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:43.760295 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-2bf30f11-9be8-45a0-8025-ffacb04ea431 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 1c099afc-d941-4044-83cc-39185d6d57b0] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:43.770292 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2bf30f11-9be8-45a0-8025-ffacb04ea431 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:43.770828 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2bf30f11-9be8-45a0-8025-ffacb04ea431 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:43.771675 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2bf30f11-9be8-45a0-8025-ffacb04ea431 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:43.772172 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2bf30f11-9be8-45a0-8025-ffacb04ea431 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:44.487583 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-3a76b374-3f74-4268-9eb0-4247f1b76033 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:44.499368 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-3a76b374-3f74-4268-9eb0-4247f1b76033 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:44.501075 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-3a76b374-3f74-4268-9eb0-4247f1b76033 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:44.502342 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-3a76b374-3f74-4268-9eb0-4247f1b76033 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1810 microversion: 2.20 time: 1.325702 Feb 17 04:40:44.504324 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 296/602] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:40:43 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1810 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 04:40:44.509125 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-e0b5f719-2f17-47d5-8064-415975518ace tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:44.509925 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-e0b5f719-2f17-47d5-8064-415975518ace tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: b5217ba8-1c7d-4811-bc6f-daeedd5d8d02] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:44.518611 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e0b5f719-2f17-47d5-8064-415975518ace tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:44.519318 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e0b5f719-2f17-47d5-8064-415975518ace tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:44.520225 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e0b5f719-2f17-47d5-8064-415975518ace tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:44.520776 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e0b5f719-2f17-47d5-8064-415975518ace tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:44.576146 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.wsgi [None req-e0b5f719-2f17-47d5-8064-415975518ace tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] HTTP exception thrown: Instance b5217ba8-1c7d-4811-bc6f-daeedd5d8d02 could not be found. Feb 17 04:40:44.576885 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-e0b5f719-2f17-47d5-8064-415975518ace tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Returning 404 to user: Instance b5217ba8-1c7d-4811-bc6f-daeedd5d8d02 could not be found. {{(pid=98081) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:40:44.577904 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-e0b5f719-2f17-47d5-8064-415975518ace tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "GET /compute/v2.1/servers/b5217ba8-1c7d-4811-bc6f-daeedd5d8d02" status: 404 len: 111 microversion: 2.1 time: 0.072401 Feb 17 04:40:44.578506 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 297/603] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:44 2021] GET /compute/v2.1/servers/b5217ba8-1c7d-4811-bc6f-daeedd5d8d02 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:40:44.583353 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-a533a8f3-5360-448c-9d5f-6b9c94ac6431 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:44.584196 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-a533a8f3-5360-448c-9d5f-6b9c94ac6431 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] [instance: 9231f663-c4c6-4723-8d42-377d3f6dd031] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:44.592733 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a533a8f3-5360-448c-9d5f-6b9c94ac6431 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:44.593244 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a533a8f3-5360-448c-9d5f-6b9c94ac6431 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:44.594093 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a533a8f3-5360-448c-9d5f-6b9c94ac6431 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:44.594654 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a533a8f3-5360-448c-9d5f-6b9c94ac6431 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:44.871607 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-2bf30f11-9be8-45a0-8025-ffacb04ea431 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:44.881433 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-2bf30f11-9be8-45a0-8025-ffacb04ea431 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0" status: 200 len: 1507 microversion: 2.1 time: 1.126280 Feb 17 04:40:44.882352 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 307/604] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:43 2021] GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0 => generated 1507 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:40:44.887474 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [req-205f5f40-cf12-429d-b4c5-977d687b5e1c req-432a1b6d-ec95-424a-b973-981a77448020 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c099afc-d941-4044-83cc-39185d6d57b0", "name": "network-vif-unplugged", "status": "completed", "tag": "1dc54b74-4d8c-493a-918e-f2cbda4994d3"}]} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:40:44.889629 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:40:44.889629 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:40:44.899173 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-205f5f40-cf12-429d-b4c5-977d687b5e1c req-432a1b6d-ec95-424a-b973-981a77448020 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:44.899672 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-205f5f40-cf12-429d-b4c5-977d687b5e1c req-432a1b6d-ec95-424a-b973-981a77448020 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:45.081022 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.compute.server_external_events [req-205f5f40-cf12-429d-b4c5-977d687b5e1c req-432a1b6d-ec95-424a-b973-981a77448020 service nova] Creating event network-vif-unplugged:1dc54b74-4d8c-493a-918e-f2cbda4994d3 for instance 1c099afc-d941-4044-83cc-39185d6d57b0 on hv-cinder-76019 Feb 17 04:40:45.087033 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [req-205f5f40-cf12-429d-b4c5-977d687b5e1c req-432a1b6d-ec95-424a-b973-981a77448020 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.203272 Feb 17 04:40:45.087737 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 308/605] 10.222.0.38 () {64 vars in 1308 bytes} [Wed Feb 17 04:40:44 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:40:45.094050 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-46e5d59a-b402-4324-914e-49a8271c9550 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:45.095099 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-46e5d59a-b402-4324-914e-49a8271c9550 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] [instance: 34275f2e-8b70-44f1-826d-bff0192f8438] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:45.103483 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-46e5d59a-b402-4324-914e-49a8271c9550 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:45.104001 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-46e5d59a-b402-4324-914e-49a8271c9550 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:45.104855 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-46e5d59a-b402-4324-914e-49a8271c9550 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:45.105350 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-46e5d59a-b402-4324-914e-49a8271c9550 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:45.569085 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-46e5d59a-b402-4324-914e-49a8271c9550 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a3efaa75e64645abf7555ccfe348d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b23386679f44b7e9d4204ab1e9adf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:45.577903 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-46e5d59a-b402-4324-914e-49a8271c9550 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] 10.222.0.38 "GET /compute/v2.1/servers/34275f2e-8b70-44f1-826d-bff0192f8438" status: 200 len: 1277 microversion: 2.1 time: 0.488047 Feb 17 04:40:45.589041 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 309/606] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:45 2021] GET /compute/v2.1/servers/34275f2e-8b70-44f1-826d-bff0192f8438 => generated 1277 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:40:45.589041 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-2163b366-3114-4dd8-b21e-be26e328ebbf tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:45.589041 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-2163b366-3114-4dd8-b21e-be26e328ebbf tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:45.592504 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2163b366-3114-4dd8-b21e-be26e328ebbf tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:45.593015 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2163b366-3114-4dd8-b21e-be26e328ebbf tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:45.593993 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2163b366-3114-4dd8-b21e-be26e328ebbf tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:45.594334 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2163b366-3114-4dd8-b21e-be26e328ebbf tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:45.596557 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-a533a8f3-5360-448c-9d5f-6b9c94ac6431 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190727a0bed54b52913aa6aa1ff8cea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57600d4d269474ab7d2f3e7ebf528ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:45.607165 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-a533a8f3-5360-448c-9d5f-6b9c94ac6431 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] 10.222.0.38 "GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031" status: 200 len: 1760 microversion: 2.1 time: 1.027327 Feb 17 04:40:45.607877 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 298/607] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:44 2021] GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031 => generated 1760 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:40:45.846615 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-921e073e-507f-4f59-a250-91490e4c99f4 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:45.847226 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-921e073e-507f-4f59-a250-91490e4c99f4 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: 4c526cd8-5f97-4b6f-af6a-ab22442bf0d6] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:45.855046 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-921e073e-507f-4f59-a250-91490e4c99f4 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:45.855556 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-921e073e-507f-4f59-a250-91490e4c99f4 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:45.856397 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-921e073e-507f-4f59-a250-91490e4c99f4 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:45.856887 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-921e073e-507f-4f59-a250-91490e4c99f4 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:45.923614 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-921e073e-507f-4f59-a250-91490e4c99f4 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: 4c526cd8-5f97-4b6f-af6a-ab22442bf0d6] Going to try to terminate instance {{(pid=98081) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 04:40:46.044663 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-921e073e-507f-4f59-a250-91490e4c99f4 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "DELETE /compute/v2.1/servers/4c526cd8-5f97-4b6f-af6a-ab22442bf0d6" status: 204 len: 0 microversion: 2.1 time: 0.201559 Feb 17 04:40:46.045961 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 299/608] 10.222.0.38 () {58 vars in 1229 bytes} [Wed Feb 17 04:40:45 2021] DELETE /compute/v2.1/servers/4c526cd8-5f97-4b6f-af6a-ab22442bf0d6 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 17 04:40:46.051245 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-1eb89db5-9c5d-4405-a4d1-b8b0cd55e752 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:46.052013 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-1eb89db5-9c5d-4405-a4d1-b8b0cd55e752 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 1c099afc-d941-4044-83cc-39185d6d57b0] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:46.060524 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1eb89db5-9c5d-4405-a4d1-b8b0cd55e752 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:46.061038 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1eb89db5-9c5d-4405-a4d1-b8b0cd55e752 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:46.061979 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1eb89db5-9c5d-4405-a4d1-b8b0cd55e752 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:46.062473 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1eb89db5-9c5d-4405-a4d1-b8b0cd55e752 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:46.536266 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-2163b366-3114-4dd8-b21e-be26e328ebbf tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:46.546249 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-2163b366-3114-4dd8-b21e-be26e328ebbf tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:46.547859 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-2163b366-3114-4dd8-b21e-be26e328ebbf tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:46.549047 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-2163b366-3114-4dd8-b21e-be26e328ebbf tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1797 microversion: 2.20 time: 0.969513 Feb 17 04:40:46.549639 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 310/609] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:40:45 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1797 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:40:46.555073 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-d1d4fddf-7aae-4ca4-9d68-9d6d2b66f73c tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:46.556022 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-d1d4fddf-7aae-4ca4-9d68-9d6d2b66f73c tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: 4c526cd8-5f97-4b6f-af6a-ab22442bf0d6] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:46.563725 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d1d4fddf-7aae-4ca4-9d68-9d6d2b66f73c tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:46.564403 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d1d4fddf-7aae-4ca4-9d68-9d6d2b66f73c tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:46.565071 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d1d4fddf-7aae-4ca4-9d68-9d6d2b66f73c tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:46.565574 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d1d4fddf-7aae-4ca4-9d68-9d6d2b66f73c tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:46.890918 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-1eb89db5-9c5d-4405-a4d1-b8b0cd55e752 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:46.901969 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-1eb89db5-9c5d-4405-a4d1-b8b0cd55e752 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0" status: 200 len: 1507 microversion: 2.1 time: 0.854952 Feb 17 04:40:46.902596 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 300/610] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:46 2021] GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0 => generated 1507 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:40:46.907267 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-e5374fce-1f2d-4c65-bac0-838cb65b2dfc tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:46.907924 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-e5374fce-1f2d-4c65-bac0-838cb65b2dfc tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] [instance: 34275f2e-8b70-44f1-826d-bff0192f8438] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:46.916443 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e5374fce-1f2d-4c65-bac0-838cb65b2dfc tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:46.916947 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e5374fce-1f2d-4c65-bac0-838cb65b2dfc tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:46.917787 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e5374fce-1f2d-4c65-bac0-838cb65b2dfc tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:46.918281 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e5374fce-1f2d-4c65-bac0-838cb65b2dfc tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:47.133177 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-e5374fce-1f2d-4c65-bac0-838cb65b2dfc tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a3efaa75e64645abf7555ccfe348d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b23386679f44b7e9d4204ab1e9adf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:47.142047 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-e5374fce-1f2d-4c65-bac0-838cb65b2dfc tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] 10.222.0.38 "GET /compute/v2.1/servers/34275f2e-8b70-44f1-826d-bff0192f8438" status: 200 len: 1277 microversion: 2.1 time: 0.238341 Feb 17 04:40:47.142680 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 301/611] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:46 2021] GET /compute/v2.1/servers/34275f2e-8b70-44f1-826d-bff0192f8438 => generated 1277 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:40:47.148093 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-06aac578-f573-4b19-a3ef-84d2528ed444 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:47.148842 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-06aac578-f573-4b19-a3ef-84d2528ed444 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] [instance: 9231f663-c4c6-4723-8d42-377d3f6dd031] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:47.158885 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-06aac578-f573-4b19-a3ef-84d2528ed444 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:47.159409 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-06aac578-f573-4b19-a3ef-84d2528ed444 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:47.161574 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-06aac578-f573-4b19-a3ef-84d2528ed444 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:47.162076 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-06aac578-f573-4b19-a3ef-84d2528ed444 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:47.250045 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-d1d4fddf-7aae-4ca4-9d68-9d6d2b66f73c tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a46d18160148f3a48ef4887f6ec7da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6284f2b80524eb0a36ccebaedba767a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:47.259711 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-d1d4fddf-7aae-4ca4-9d68-9d6d2b66f73c tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "GET /compute/v2.1/servers/4c526cd8-5f97-4b6f-af6a-ab22442bf0d6" status: 200 len: 1514 microversion: 2.1 time: 0.709021 Feb 17 04:40:47.260312 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 311/612] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:46 2021] GET /compute/v2.1/servers/4c526cd8-5f97-4b6f-af6a-ab22442bf0d6 => generated 1514 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:40:47.513012 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [req-c4ec6aa8-7397-41b1-ab50-cc6e28a42bd7 req-36ca58d1-c694-4970-a492-7956c449a516 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c099afc-d941-4044-83cc-39185d6d57b0", "name": "network-vif-deleted", "tag": "1dc54b74-4d8c-493a-918e-f2cbda4994d3"}]} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:40:47.514798 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:40:47.514798 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:40:47.524571 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-c4ec6aa8-7397-41b1-ab50-cc6e28a42bd7 req-36ca58d1-c694-4970-a492-7956c449a516 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:47.525112 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-c4ec6aa8-7397-41b1-ab50-cc6e28a42bd7 req-36ca58d1-c694-4970-a492-7956c449a516 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:47.542947 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.compute.server_external_events [req-c4ec6aa8-7397-41b1-ab50-cc6e28a42bd7 req-36ca58d1-c694-4970-a492-7956c449a516 service nova] Creating event network-vif-deleted:1dc54b74-4d8c-493a-918e-f2cbda4994d3 for instance 1c099afc-d941-4044-83cc-39185d6d57b0 on hv-cinder-76019 Feb 17 04:40:47.547952 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [req-c4ec6aa8-7397-41b1-ab50-cc6e28a42bd7 req-36ca58d1-c694-4970-a492-7956c449a516 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038837 Feb 17 04:40:47.548605 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 312/613] 10.222.0.38 () {64 vars in 1308 bytes} [Wed Feb 17 04:40:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:40:47.689629 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-06aac578-f573-4b19-a3ef-84d2528ed444 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190727a0bed54b52913aa6aa1ff8cea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57600d4d269474ab7d2f3e7ebf528ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:47.700055 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-06aac578-f573-4b19-a3ef-84d2528ed444 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] 10.222.0.38 "GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031" status: 200 len: 1765 microversion: 2.1 time: 0.556374 Feb 17 04:40:47.700655 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 302/614] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:47 2021] GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031 => generated 1765 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:40:47.921698 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-29a05fc9-3c62-4d5e-ba3b-78b54f104fb2 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:47.922511 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-29a05fc9-3c62-4d5e-ba3b-78b54f104fb2 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 1c099afc-d941-4044-83cc-39185d6d57b0] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:47.931335 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-29a05fc9-3c62-4d5e-ba3b-78b54f104fb2 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:47.931845 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-29a05fc9-3c62-4d5e-ba3b-78b54f104fb2 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:47.932697 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-29a05fc9-3c62-4d5e-ba3b-78b54f104fb2 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:47.933186 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-29a05fc9-3c62-4d5e-ba3b-78b54f104fb2 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:48.010054 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-29a05fc9-3c62-4d5e-ba3b-78b54f104fb2 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:48.010588 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-29a05fc9-3c62-4d5e-ba3b-78b54f104fb2 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:48.011098 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.objects.instance [None req-29a05fc9-3c62-4d5e-ba3b-78b54f104fb2 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lazy-loading 'fault' on Instance uuid 1c099afc-d941-4044-83cc-39185d6d57b0 {{(pid=98080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:40:48.161565 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-33149848-e4b8-41bf-a68c-af359f0ddb7c tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:48.162269 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-33149848-e4b8-41bf-a68c-af359f0ddb7c tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] [instance: 34275f2e-8b70-44f1-826d-bff0192f8438] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:48.170323 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-33149848-e4b8-41bf-a68c-af359f0ddb7c tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:48.170894 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-33149848-e4b8-41bf-a68c-af359f0ddb7c tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:48.172145 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-33149848-e4b8-41bf-a68c-af359f0ddb7c tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:48.172505 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-33149848-e4b8-41bf-a68c-af359f0ddb7c tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:48.225758 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-29a05fc9-3c62-4d5e-ba3b-78b54f104fb2 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:48.235632 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-29a05fc9-3c62-4d5e-ba3b-78b54f104fb2 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0" status: 200 len: 1311 microversion: 2.1 time: 0.318536 Feb 17 04:40:48.236764 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 313/615] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:47 2021] GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0 => generated 1311 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:40:48.279309 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-2561b270-bcca-4a87-87a0-9071f9f06847 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:48.280276 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-2561b270-bcca-4a87-87a0-9071f9f06847 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: 4c526cd8-5f97-4b6f-af6a-ab22442bf0d6] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:48.289700 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2561b270-bcca-4a87-87a0-9071f9f06847 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:48.290470 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2561b270-bcca-4a87-87a0-9071f9f06847 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:48.291642 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2561b270-bcca-4a87-87a0-9071f9f06847 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:48.292028 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2561b270-bcca-4a87-87a0-9071f9f06847 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:49.105819 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-2561b270-bcca-4a87-87a0-9071f9f06847 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a46d18160148f3a48ef4887f6ec7da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6284f2b80524eb0a36ccebaedba767a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:49.114952 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-2561b270-bcca-4a87-87a0-9071f9f06847 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "GET /compute/v2.1/servers/4c526cd8-5f97-4b6f-af6a-ab22442bf0d6" status: 200 len: 1514 microversion: 2.1 time: 0.839959 Feb 17 04:40:49.115553 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 314/616] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:48 2021] GET /compute/v2.1/servers/4c526cd8-5f97-4b6f-af6a-ab22442bf0d6 => generated 1514 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:40:49.120171 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-201d8f77-3270-49f4-93a6-3946b75b6602 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:49.120799 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-201d8f77-3270-49f4-93a6-3946b75b6602 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] [instance: 9231f663-c4c6-4723-8d42-377d3f6dd031] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:49.128466 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-201d8f77-3270-49f4-93a6-3946b75b6602 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:49.129198 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-201d8f77-3270-49f4-93a6-3946b75b6602 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:49.130318 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-201d8f77-3270-49f4-93a6-3946b75b6602 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:49.130716 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-201d8f77-3270-49f4-93a6-3946b75b6602 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:49.133033 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-33149848-e4b8-41bf-a68c-af359f0ddb7c tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a3efaa75e64645abf7555ccfe348d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b23386679f44b7e9d4204ab1e9adf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:49.142164 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-33149848-e4b8-41bf-a68c-af359f0ddb7c tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] 10.222.0.38 "GET /compute/v2.1/servers/34275f2e-8b70-44f1-826d-bff0192f8438" status: 200 len: 1319 microversion: 2.1 time: 0.985719 Feb 17 04:40:49.142883 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 303/617] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:48 2021] GET /compute/v2.1/servers/34275f2e-8b70-44f1-826d-bff0192f8438 => generated 1319 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:40:49.254536 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-89377eb7-b413-44a7-9809-845c9ba1f04c tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:49.255308 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-89377eb7-b413-44a7-9809-845c9ba1f04c tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 1c099afc-d941-4044-83cc-39185d6d57b0] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:49.263481 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-89377eb7-b413-44a7-9809-845c9ba1f04c tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:49.264068 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-89377eb7-b413-44a7-9809-845c9ba1f04c tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:49.264984 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-89377eb7-b413-44a7-9809-845c9ba1f04c tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:49.265555 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-89377eb7-b413-44a7-9809-845c9ba1f04c tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:49.322108 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.wsgi [None req-89377eb7-b413-44a7-9809-845c9ba1f04c tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] HTTP exception thrown: Instance 1c099afc-d941-4044-83cc-39185d6d57b0 could not be found. Feb 17 04:40:49.322807 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-89377eb7-b413-44a7-9809-845c9ba1f04c tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Returning 404 to user: Instance 1c099afc-d941-4044-83cc-39185d6d57b0 could not be found. {{(pid=98081) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:40:49.323723 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-89377eb7-b413-44a7-9809-845c9ba1f04c tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0" status: 404 len: 111 microversion: 2.1 time: 0.074159 Feb 17 04:40:49.327710 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 304/618] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:49 2021] GET /compute/v2.1/servers/1c099afc-d941-4044-83cc-39185d6d57b0 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:40:49.333226 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-b2d77b51-f405-4b23-85af-745224042fb8 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:49.333770 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-b2d77b51-f405-4b23-85af-745224042fb8 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 68a5c561-c418-4a68-b8b3-1600b638b80c] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:49.341516 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b2d77b51-f405-4b23-85af-745224042fb8 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:49.342018 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b2d77b51-f405-4b23-85af-745224042fb8 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:49.342880 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b2d77b51-f405-4b23-85af-745224042fb8 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:49.343375 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b2d77b51-f405-4b23-85af-745224042fb8 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:49.409333 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-b2d77b51-f405-4b23-85af-745224042fb8 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 68a5c561-c418-4a68-b8b3-1600b638b80c] Going to try to terminate instance {{(pid=98081) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 04:40:49.530468 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-b2d77b51-f405-4b23-85af-745224042fb8 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "DELETE /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c" status: 204 len: 0 microversion: 2.1 time: 0.201352 Feb 17 04:40:49.531138 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 305/619] 10.222.0.38 () {58 vars in 1229 bytes} [Wed Feb 17 04:40:49 2021] DELETE /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 17 04:40:49.537975 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [req-04e7080f-d8b1-4596-bd26-7eb97680f2ad req-a3374e0c-0443-438a-97c3-a58e9239d3e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c526cd8-5f97-4b6f-af6a-ab22442bf0d6", "name": "network-vif-unplugged", "status": "completed", "tag": "fc9a2ca9-56da-4fa9-aa32-1289ae7ac089"}]} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:40:49.540088 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:40:49.540088 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:40:49.548909 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-04e7080f-d8b1-4596-bd26-7eb97680f2ad req-a3374e0c-0443-438a-97c3-a58e9239d3e5 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:49.549407 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-04e7080f-d8b1-4596-bd26-7eb97680f2ad req-a3374e0c-0443-438a-97c3-a58e9239d3e5 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:49.572373 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.compute.server_external_events [req-04e7080f-d8b1-4596-bd26-7eb97680f2ad req-a3374e0c-0443-438a-97c3-a58e9239d3e5 service nova] Creating event network-vif-unplugged:fc9a2ca9-56da-4fa9-aa32-1289ae7ac089 for instance 4c526cd8-5f97-4b6f-af6a-ab22442bf0d6 on hv-cinder-76019 Feb 17 04:40:49.577402 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [req-04e7080f-d8b1-4596-bd26-7eb97680f2ad req-a3374e0c-0443-438a-97c3-a58e9239d3e5 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044797 Feb 17 04:40:49.578434 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 306/620] 10.222.0.38 () {64 vars in 1308 bytes} [Wed Feb 17 04:40:49 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:40:49.584133 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-1a3f817d-9587-4320-8b9e-7bc07e81183a tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:49.584898 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-1a3f817d-9587-4320-8b9e-7bc07e81183a tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 68a5c561-c418-4a68-b8b3-1600b638b80c] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:49.592983 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1a3f817d-9587-4320-8b9e-7bc07e81183a tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:49.593488 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1a3f817d-9587-4320-8b9e-7bc07e81183a tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:49.594333 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1a3f817d-9587-4320-8b9e-7bc07e81183a tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:49.594880 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1a3f817d-9587-4320-8b9e-7bc07e81183a tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:49.833788 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-201d8f77-3270-49f4-93a6-3946b75b6602 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190727a0bed54b52913aa6aa1ff8cea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57600d4d269474ab7d2f3e7ebf528ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:49.843329 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-201d8f77-3270-49f4-93a6-3946b75b6602 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] 10.222.0.38 "GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031" status: 200 len: 1765 microversion: 2.1 time: 0.726724 Feb 17 04:40:49.843938 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 315/621] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:49 2021] GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031 => generated 1765 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:40:50.134534 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-8f49c06a-9a27-4ee4-af38-c2c89f9a000f tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:50.135141 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-8f49c06a-9a27-4ee4-af38-c2c89f9a000f tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: 4c526cd8-5f97-4b6f-af6a-ab22442bf0d6] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:50.144483 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8f49c06a-9a27-4ee4-af38-c2c89f9a000f tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:50.144975 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8f49c06a-9a27-4ee4-af38-c2c89f9a000f tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:50.145839 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8f49c06a-9a27-4ee4-af38-c2c89f9a000f tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:50.146330 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8f49c06a-9a27-4ee4-af38-c2c89f9a000f tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:50.372015 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-1a3f817d-9587-4320-8b9e-7bc07e81183a tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:50.381513 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-1a3f817d-9587-4320-8b9e-7bc07e81183a tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c" status: 200 len: 1522 microversion: 2.1 time: 0.802257 Feb 17 04:40:50.382113 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 307/622] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:49 2021] GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c => generated 1522 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:40:50.386789 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-e02ff4b9-04e8-4135-a69c-682ce0a3d3a4 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:50.387397 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-e02ff4b9-04e8-4135-a69c-682ce0a3d3a4 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] [instance: 34275f2e-8b70-44f1-826d-bff0192f8438] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:50.394935 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e02ff4b9-04e8-4135-a69c-682ce0a3d3a4 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:50.395446 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e02ff4b9-04e8-4135-a69c-682ce0a3d3a4 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:50.396279 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e02ff4b9-04e8-4135-a69c-682ce0a3d3a4 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:50.396771 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e02ff4b9-04e8-4135-a69c-682ce0a3d3a4 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:50.927074 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-8f49c06a-9a27-4ee4-af38-c2c89f9a000f tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a46d18160148f3a48ef4887f6ec7da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6284f2b80524eb0a36ccebaedba767a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:50.936465 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-8f49c06a-9a27-4ee4-af38-c2c89f9a000f tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "GET /compute/v2.1/servers/4c526cd8-5f97-4b6f-af6a-ab22442bf0d6" status: 200 len: 1514 microversion: 2.1 time: 0.805917 Feb 17 04:40:50.936935 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 316/623] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:50 2021] GET /compute/v2.1/servers/4c526cd8-5f97-4b6f-af6a-ab22442bf0d6 => generated 1514 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:40:50.936935 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-98fa7cf4-968e-4f0d-ba9e-124fc18aa2eb tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:50.936935 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-98fa7cf4-968e-4f0d-ba9e-124fc18aa2eb tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] [instance: 9231f663-c4c6-4723-8d42-377d3f6dd031] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:50.950902 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-98fa7cf4-968e-4f0d-ba9e-124fc18aa2eb tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:50.951046 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-98fa7cf4-968e-4f0d-ba9e-124fc18aa2eb tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:50.952018 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-98fa7cf4-968e-4f0d-ba9e-124fc18aa2eb tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:50.952560 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-98fa7cf4-968e-4f0d-ba9e-124fc18aa2eb tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:51.344386 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-e02ff4b9-04e8-4135-a69c-682ce0a3d3a4 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a3efaa75e64645abf7555ccfe348d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b23386679f44b7e9d4204ab1e9adf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:51.354459 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-e02ff4b9-04e8-4135-a69c-682ce0a3d3a4 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] 10.222.0.38 "GET /compute/v2.1/servers/34275f2e-8b70-44f1-826d-bff0192f8438" status: 200 len: 1319 microversion: 2.1 time: 0.971223 Feb 17 04:40:51.364642 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 308/624] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:50 2021] GET /compute/v2.1/servers/34275f2e-8b70-44f1-826d-bff0192f8438 => generated 1319 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:40:51.400553 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-64d02032-eb25-4c5d-9393-5292476fbcd5 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:51.401227 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-64d02032-eb25-4c5d-9393-5292476fbcd5 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 68a5c561-c418-4a68-b8b3-1600b638b80c] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:51.416124 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-64d02032-eb25-4c5d-9393-5292476fbcd5 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:51.416711 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-64d02032-eb25-4c5d-9393-5292476fbcd5 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:51.417571 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-64d02032-eb25-4c5d-9393-5292476fbcd5 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:51.418066 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-64d02032-eb25-4c5d-9393-5292476fbcd5 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:51.739420 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-98fa7cf4-968e-4f0d-ba9e-124fc18aa2eb tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190727a0bed54b52913aa6aa1ff8cea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57600d4d269474ab7d2f3e7ebf528ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:51.749008 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-98fa7cf4-968e-4f0d-ba9e-124fc18aa2eb tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] 10.222.0.38 "GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031" status: 200 len: 1765 microversion: 2.1 time: 0.810913 Feb 17 04:40:51.749602 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 317/625] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:50 2021] GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031 => generated 1765 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:40:51.754987 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [req-e82d3b2e-e196-4f47-a7b3-4ceddee10e66 req-face7e37-316b-4b79-aa91-1a6c2dbeefe8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34275f2e-8b70-44f1-826d-bff0192f8438", "tag": "e2e0a4b5-c176-4366-a4c5-3191ea792497"}]} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:40:51.757198 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:40:51.757198 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:40:51.765291 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-e82d3b2e-e196-4f47-a7b3-4ceddee10e66 req-face7e37-316b-4b79-aa91-1a6c2dbeefe8 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:51.765792 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-e82d3b2e-e196-4f47-a7b3-4ceddee10e66 req-face7e37-316b-4b79-aa91-1a6c2dbeefe8 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:51.783537 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.compute.server_external_events [req-e82d3b2e-e196-4f47-a7b3-4ceddee10e66 req-face7e37-316b-4b79-aa91-1a6c2dbeefe8 service nova] Creating event network-changed:e2e0a4b5-c176-4366-a4c5-3191ea792497 for instance 34275f2e-8b70-44f1-826d-bff0192f8438 on hv-cinder-76019 Feb 17 04:40:51.788499 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [req-e82d3b2e-e196-4f47-a7b3-4ceddee10e66 req-face7e37-316b-4b79-aa91-1a6c2dbeefe8 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037685 Feb 17 04:40:51.789139 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 318/626] 10.222.0.38 () {64 vars in 1308 bytes} [Wed Feb 17 04:40:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:40:51.959040 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-ee6a4d9b-b1c3-49e4-a1fb-0cf5d01614df tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:51.959568 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-ee6a4d9b-b1c3-49e4-a1fb-0cf5d01614df tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: 4c526cd8-5f97-4b6f-af6a-ab22442bf0d6] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:51.968873 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ee6a4d9b-b1c3-49e4-a1fb-0cf5d01614df tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:51.969506 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ee6a4d9b-b1c3-49e4-a1fb-0cf5d01614df tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:51.971408 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ee6a4d9b-b1c3-49e4-a1fb-0cf5d01614df tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:51.972057 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ee6a4d9b-b1c3-49e4-a1fb-0cf5d01614df tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:52.056313 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-64d02032-eb25-4c5d-9393-5292476fbcd5 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:52.065391 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-64d02032-eb25-4c5d-9393-5292476fbcd5 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c" status: 200 len: 1522 microversion: 2.1 time: 0.668787 Feb 17 04:40:52.066908 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 309/627] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:51 2021] GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c => generated 1522 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:40:52.186282 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-ee6a4d9b-b1c3-49e4-a1fb-0cf5d01614df tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a46d18160148f3a48ef4887f6ec7da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6284f2b80524eb0a36ccebaedba767a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:52.214749 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-ee6a4d9b-b1c3-49e4-a1fb-0cf5d01614df tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "GET /compute/v2.1/servers/4c526cd8-5f97-4b6f-af6a-ab22442bf0d6" status: 200 len: 1472 microversion: 2.1 time: 0.260792 Feb 17 04:40:52.215616 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 319/628] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:51 2021] GET /compute/v2.1/servers/4c526cd8-5f97-4b6f-af6a-ab22442bf0d6 => generated 1472 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:40:52.372217 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-7a23ccd6-a95c-4371-a797-29734c657d4a tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:52.372891 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-7a23ccd6-a95c-4371-a797-29734c657d4a tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] [instance: 34275f2e-8b70-44f1-826d-bff0192f8438] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:52.381946 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7a23ccd6-a95c-4371-a797-29734c657d4a tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:52.382463 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7a23ccd6-a95c-4371-a797-29734c657d4a tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:52.383367 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7a23ccd6-a95c-4371-a797-29734c657d4a tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:52.383865 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7a23ccd6-a95c-4371-a797-29734c657d4a tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:52.768107 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-028e19c4-723d-4118-9643-563fac6912ef tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:52.768829 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-028e19c4-723d-4118-9643-563fac6912ef tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] [instance: 9231f663-c4c6-4723-8d42-377d3f6dd031] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:52.777107 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-028e19c4-723d-4118-9643-563fac6912ef tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:52.777392 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-028e19c4-723d-4118-9643-563fac6912ef tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:52.778229 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-028e19c4-723d-4118-9643-563fac6912ef tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:52.778874 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-028e19c4-723d-4118-9643-563fac6912ef tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:52.920221 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-7a23ccd6-a95c-4371-a797-29734c657d4a tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a3efaa75e64645abf7555ccfe348d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b23386679f44b7e9d4204ab1e9adf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:52.929749 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-7a23ccd6-a95c-4371-a797-29734c657d4a tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] 10.222.0.38 "GET /compute/v2.1/servers/34275f2e-8b70-44f1-826d-bff0192f8438" status: 200 len: 1319 microversion: 2.1 time: 0.561593 Feb 17 04:40:52.930354 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 310/629] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:52 2021] GET /compute/v2.1/servers/34275f2e-8b70-44f1-826d-bff0192f8438 => generated 1319 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:40:53.085236 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-d39cde49-4197-4783-b356-e89b8d50e897 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:53.086048 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-d39cde49-4197-4783-b356-e89b8d50e897 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 68a5c561-c418-4a68-b8b3-1600b638b80c] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:53.094033 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d39cde49-4197-4783-b356-e89b8d50e897 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:53.094697 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d39cde49-4197-4783-b356-e89b8d50e897 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:53.095977 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d39cde49-4197-4783-b356-e89b8d50e897 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:53.096090 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d39cde49-4197-4783-b356-e89b8d50e897 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:53.147301 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-028e19c4-723d-4118-9643-563fac6912ef tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190727a0bed54b52913aa6aa1ff8cea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57600d4d269474ab7d2f3e7ebf528ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:53.157041 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-028e19c4-723d-4118-9643-563fac6912ef tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] 10.222.0.38 "GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031" status: 200 len: 1765 microversion: 2.1 time: 0.392905 Feb 17 04:40:53.157933 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 320/630] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:52 2021] GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031 => generated 1765 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:40:53.233916 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-2544ae5d-d340-493b-b6a5-6b2d693fb18b tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:53.234601 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-2544ae5d-d340-493b-b6a5-6b2d693fb18b tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: 4c526cd8-5f97-4b6f-af6a-ab22442bf0d6] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:53.242401 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2544ae5d-d340-493b-b6a5-6b2d693fb18b tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:53.242933 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2544ae5d-d340-493b-b6a5-6b2d693fb18b tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:53.243811 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2544ae5d-d340-493b-b6a5-6b2d693fb18b tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:53.244297 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2544ae5d-d340-493b-b6a5-6b2d693fb18b tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:53.301626 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.wsgi [None req-2544ae5d-d340-493b-b6a5-6b2d693fb18b tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] HTTP exception thrown: Instance 4c526cd8-5f97-4b6f-af6a-ab22442bf0d6 could not be found. Feb 17 04:40:53.302297 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-2544ae5d-d340-493b-b6a5-6b2d693fb18b tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Returning 404 to user: Instance 4c526cd8-5f97-4b6f-af6a-ab22442bf0d6 could not be found. {{(pid=98080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:40:53.303255 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-2544ae5d-d340-493b-b6a5-6b2d693fb18b tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "GET /compute/v2.1/servers/4c526cd8-5f97-4b6f-af6a-ab22442bf0d6" status: 404 len: 111 microversion: 2.1 time: 0.073338 Feb 17 04:40:53.304228 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 321/631] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:53 2021] GET /compute/v2.1/servers/4c526cd8-5f97-4b6f-af6a-ab22442bf0d6 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:40:53.312309 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-df24ea7a-6b20-4b1c-8931-b19efced4cd8 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:53.312857 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-df24ea7a-6b20-4b1c-8931-b19efced4cd8 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: 5d8fcb1f-fa8f-4a61-8e8b-77a64053ca3c] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:53.320778 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-df24ea7a-6b20-4b1c-8931-b19efced4cd8 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:53.321286 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-df24ea7a-6b20-4b1c-8931-b19efced4cd8 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:53.322121 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-df24ea7a-6b20-4b1c-8931-b19efced4cd8 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:53.322651 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-df24ea7a-6b20-4b1c-8931-b19efced4cd8 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:53.387986 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-df24ea7a-6b20-4b1c-8931-b19efced4cd8 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: 5d8fcb1f-fa8f-4a61-8e8b-77a64053ca3c] Going to try to terminate instance {{(pid=98080) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 04:40:53.506804 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-df24ea7a-6b20-4b1c-8931-b19efced4cd8 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "DELETE /compute/v2.1/servers/5d8fcb1f-fa8f-4a61-8e8b-77a64053ca3c" status: 204 len: 0 microversion: 2.1 time: 0.197976 Feb 17 04:40:53.507311 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 322/632] 10.222.0.38 () {58 vars in 1229 bytes} [Wed Feb 17 04:40:53 2021] DELETE /compute/v2.1/servers/5d8fcb1f-fa8f-4a61-8e8b-77a64053ca3c => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 17 04:40:53.516041 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-b4479f24-9977-4e04-92a1-54134375746c tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:53.516808 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-b4479f24-9977-4e04-92a1-54134375746c tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: 5d8fcb1f-fa8f-4a61-8e8b-77a64053ca3c] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:53.524940 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b4479f24-9977-4e04-92a1-54134375746c tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:53.525446 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b4479f24-9977-4e04-92a1-54134375746c tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:53.526273 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b4479f24-9977-4e04-92a1-54134375746c tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:53.526797 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b4479f24-9977-4e04-92a1-54134375746c tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:53.565573 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-d39cde49-4197-4783-b356-e89b8d50e897 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:53.574484 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-d39cde49-4197-4783-b356-e89b8d50e897 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c" status: 200 len: 1522 microversion: 2.1 time: 0.494419 Feb 17 04:40:53.575126 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 311/633] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:53 2021] GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c => generated 1522 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:40:53.811465 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [req-419ef830-50e3-450f-9df0-c68e0161f097 req-f598f218-2702-4aa4-b523-eca6ce55d252 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c526cd8-5f97-4b6f-af6a-ab22442bf0d6", "name": "network-vif-deleted", "tag": "fc9a2ca9-56da-4fa9-aa32-1289ae7ac089"}]} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:40:53.813115 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:40:53.813115 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:40:53.822909 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-419ef830-50e3-450f-9df0-c68e0161f097 req-f598f218-2702-4aa4-b523-eca6ce55d252 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:53.823416 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-419ef830-50e3-450f-9df0-c68e0161f097 req-f598f218-2702-4aa4-b523-eca6ce55d252 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:53.842117 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.compute.server_external_events [req-419ef830-50e3-450f-9df0-c68e0161f097 req-f598f218-2702-4aa4-b523-eca6ce55d252 service nova] Creating event network-vif-deleted:fc9a2ca9-56da-4fa9-aa32-1289ae7ac089 for instance 4c526cd8-5f97-4b6f-af6a-ab22442bf0d6 on hv-cinder-76019 Feb 17 04:40:53.847514 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [req-419ef830-50e3-450f-9df0-c68e0161f097 req-f598f218-2702-4aa4-b523-eca6ce55d252 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040368 Feb 17 04:40:53.848598 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 312/634] 10.222.0.38 () {64 vars in 1308 bytes} [Wed Feb 17 04:40:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:40:53.886707 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-b4479f24-9977-4e04-92a1-54134375746c tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a46d18160148f3a48ef4887f6ec7da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6284f2b80524eb0a36ccebaedba767a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:53.897405 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-b4479f24-9977-4e04-92a1-54134375746c tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "GET /compute/v2.1/servers/5d8fcb1f-fa8f-4a61-8e8b-77a64053ca3c" status: 200 len: 1515 microversion: 2.1 time: 0.385532 Feb 17 04:40:53.898020 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 323/635] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:53 2021] GET /compute/v2.1/servers/5d8fcb1f-fa8f-4a61-8e8b-77a64053ca3c => generated 1515 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:40:53.949963 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-573391c6-c66e-431e-944a-b1873f51104e tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:53.950751 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-573391c6-c66e-431e-944a-b1873f51104e tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] [instance: 34275f2e-8b70-44f1-826d-bff0192f8438] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:53.959755 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-573391c6-c66e-431e-944a-b1873f51104e tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:53.960270 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-573391c6-c66e-431e-944a-b1873f51104e tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:53.961111 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-573391c6-c66e-431e-944a-b1873f51104e tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:53.961606 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-573391c6-c66e-431e-944a-b1873f51104e tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:54.176608 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-da0e4a60-8747-444f-8e1a-a25bfeb79853 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:54.176884 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-573391c6-c66e-431e-944a-b1873f51104e tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a3efaa75e64645abf7555ccfe348d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b23386679f44b7e9d4204ab1e9adf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:54.177270 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-da0e4a60-8747-444f-8e1a-a25bfeb79853 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] [instance: 9231f663-c4c6-4723-8d42-377d3f6dd031] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:54.185313 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-da0e4a60-8747-444f-8e1a-a25bfeb79853 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:54.185814 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-da0e4a60-8747-444f-8e1a-a25bfeb79853 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:54.185927 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-573391c6-c66e-431e-944a-b1873f51104e tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] 10.222.0.38 "GET /compute/v2.1/servers/34275f2e-8b70-44f1-826d-bff0192f8438" status: 200 len: 1319 microversion: 2.1 time: 0.240461 Feb 17 04:40:54.186467 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 313/636] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:53 2021] GET /compute/v2.1/servers/34275f2e-8b70-44f1-826d-bff0192f8438 => generated 1319 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:40:54.186676 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-da0e4a60-8747-444f-8e1a-a25bfeb79853 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:54.187167 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-da0e4a60-8747-444f-8e1a-a25bfeb79853 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:54.402079 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-da0e4a60-8747-444f-8e1a-a25bfeb79853 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190727a0bed54b52913aa6aa1ff8cea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57600d4d269474ab7d2f3e7ebf528ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:54.412476 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-da0e4a60-8747-444f-8e1a-a25bfeb79853 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] 10.222.0.38 "GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031" status: 200 len: 1765 microversion: 2.1 time: 0.240446 Feb 17 04:40:54.413078 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 324/637] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:54 2021] GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031 => generated 1765 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:40:54.593268 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-79aa388a-6ce2-483c-a2aa-27a30fb59b8c tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:54.593939 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-79aa388a-6ce2-483c-a2aa-27a30fb59b8c tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 68a5c561-c418-4a68-b8b3-1600b638b80c] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:54.602056 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-79aa388a-6ce2-483c-a2aa-27a30fb59b8c tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:54.602577 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-79aa388a-6ce2-483c-a2aa-27a30fb59b8c tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:54.603433 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-79aa388a-6ce2-483c-a2aa-27a30fb59b8c tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:54.603924 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-79aa388a-6ce2-483c-a2aa-27a30fb59b8c tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:54.811654 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-79aa388a-6ce2-483c-a2aa-27a30fb59b8c tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:54.821114 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-79aa388a-6ce2-483c-a2aa-27a30fb59b8c tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c" status: 200 len: 1522 microversion: 2.1 time: 0.231819 Feb 17 04:40:54.821715 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 314/638] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:54 2021] GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c => generated 1522 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:40:54.916194 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-a855569d-603c-4480-a17e-40ca4a8749f2 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:54.916864 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-a855569d-603c-4480-a17e-40ca4a8749f2 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: 5d8fcb1f-fa8f-4a61-8e8b-77a64053ca3c] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:54.924712 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a855569d-603c-4480-a17e-40ca4a8749f2 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:54.925832 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a855569d-603c-4480-a17e-40ca4a8749f2 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:54.926721 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a855569d-603c-4480-a17e-40ca4a8749f2 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:54.927215 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a855569d-603c-4480-a17e-40ca4a8749f2 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:55.139509 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-a855569d-603c-4480-a17e-40ca4a8749f2 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a46d18160148f3a48ef4887f6ec7da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6284f2b80524eb0a36ccebaedba767a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:55.148422 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-a855569d-603c-4480-a17e-40ca4a8749f2 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "GET /compute/v2.1/servers/5d8fcb1f-fa8f-4a61-8e8b-77a64053ca3c" status: 200 len: 1515 microversion: 2.1 time: 0.236258 Feb 17 04:40:55.149035 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 325/639] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:54 2021] GET /compute/v2.1/servers/5d8fcb1f-fa8f-4a61-8e8b-77a64053ca3c => generated 1515 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:40:55.204280 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-9290fb96-33de-45f1-930c-41809ea2e9b5 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:55.204950 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-9290fb96-33de-45f1-930c-41809ea2e9b5 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] [instance: 34275f2e-8b70-44f1-826d-bff0192f8438] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:55.212793 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9290fb96-33de-45f1-930c-41809ea2e9b5 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:55.213300 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9290fb96-33de-45f1-930c-41809ea2e9b5 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:55.214122 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9290fb96-33de-45f1-930c-41809ea2e9b5 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:55.214631 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9290fb96-33de-45f1-930c-41809ea2e9b5 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:55.430824 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-629909e4-a780-45b5-8322-a3af6b4606d3 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:55.431642 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-629909e4-a780-45b5-8322-a3af6b4606d3 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] [instance: 9231f663-c4c6-4723-8d42-377d3f6dd031] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:55.439651 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-629909e4-a780-45b5-8322-a3af6b4606d3 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:55.440167 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-629909e4-a780-45b5-8322-a3af6b4606d3 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:55.441646 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-629909e4-a780-45b5-8322-a3af6b4606d3 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:55.442149 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-629909e4-a780-45b5-8322-a3af6b4606d3 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:55.602171 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-9290fb96-33de-45f1-930c-41809ea2e9b5 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a3efaa75e64645abf7555ccfe348d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b23386679f44b7e9d4204ab1e9adf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:55.611212 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-9290fb96-33de-45f1-930c-41809ea2e9b5 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] 10.222.0.38 "GET /compute/v2.1/servers/34275f2e-8b70-44f1-826d-bff0192f8438" status: 200 len: 1319 microversion: 2.1 time: 0.410893 Feb 17 04:40:55.611826 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 315/640] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:55 2021] GET /compute/v2.1/servers/34275f2e-8b70-44f1-826d-bff0192f8438 => generated 1319 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:40:55.840137 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-0a7da6a4-1228-4809-b3a3-58ec33e27885 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:55.841025 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-0a7da6a4-1228-4809-b3a3-58ec33e27885 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 68a5c561-c418-4a68-b8b3-1600b638b80c] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:55.858126 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0a7da6a4-1228-4809-b3a3-58ec33e27885 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:55.858651 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0a7da6a4-1228-4809-b3a3-58ec33e27885 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:55.859511 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0a7da6a4-1228-4809-b3a3-58ec33e27885 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:55.859998 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0a7da6a4-1228-4809-b3a3-58ec33e27885 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:55.991949 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-629909e4-a780-45b5-8322-a3af6b4606d3 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190727a0bed54b52913aa6aa1ff8cea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57600d4d269474ab7d2f3e7ebf528ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:56.012295 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-629909e4-a780-45b5-8322-a3af6b4606d3 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] 10.222.0.38 "GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031" status: 200 len: 1765 microversion: 2.1 time: 0.585443 Feb 17 04:40:56.012912 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 326/641] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:55 2021] GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031 => generated 1765 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:40:56.111917 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [req-32adf34f-dfd0-4d57-b53d-e22eeec35f59 req-11bbbdf5-768a-47c7-84bf-ad2eef819d7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34275f2e-8b70-44f1-826d-bff0192f8438", "name": "network-vif-plugged", "status": "completed", "tag": "e2e0a4b5-c176-4366-a4c5-3191ea792497"}]} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:40:56.113814 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:40:56.113814 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:40:56.123388 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-32adf34f-dfd0-4d57-b53d-e22eeec35f59 req-11bbbdf5-768a-47c7-84bf-ad2eef819d7d service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:56.123609 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-32adf34f-dfd0-4d57-b53d-e22eeec35f59 req-11bbbdf5-768a-47c7-84bf-ad2eef819d7d service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:56.146038 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.compute.server_external_events [req-32adf34f-dfd0-4d57-b53d-e22eeec35f59 req-11bbbdf5-768a-47c7-84bf-ad2eef819d7d service nova] Creating event network-vif-plugged:e2e0a4b5-c176-4366-a4c5-3191ea792497 for instance 34275f2e-8b70-44f1-826d-bff0192f8438 on hv-cinder-76019 Feb 17 04:40:56.151721 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [req-32adf34f-dfd0-4d57-b53d-e22eeec35f59 req-11bbbdf5-768a-47c7-84bf-ad2eef819d7d service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043557 Feb 17 04:40:56.152481 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 327/642] 10.222.0.38 () {64 vars in 1308 bytes} [Wed Feb 17 04:40:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:40:56.168028 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-5c4822e7-6f6f-499f-a000-e860cd05b1e5 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:56.168786 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-5c4822e7-6f6f-499f-a000-e860cd05b1e5 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: 5d8fcb1f-fa8f-4a61-8e8b-77a64053ca3c] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:56.177660 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5c4822e7-6f6f-499f-a000-e860cd05b1e5 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:56.178995 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5c4822e7-6f6f-499f-a000-e860cd05b1e5 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:56.179197 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5c4822e7-6f6f-499f-a000-e860cd05b1e5 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:56.179680 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5c4822e7-6f6f-499f-a000-e860cd05b1e5 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:57.103487 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-0a7da6a4-1228-4809-b3a3-58ec33e27885 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:57.115173 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-0a7da6a4-1228-4809-b3a3-58ec33e27885 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c" status: 200 len: 1522 microversion: 2.1 time: 1.278849 Feb 17 04:40:57.115769 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 316/643] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:55 2021] GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c => generated 1522 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:40:57.120708 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-92c0e203-ff1c-4b9f-8463-d94b7524c862 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:57.121596 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-92c0e203-ff1c-4b9f-8463-d94b7524c862 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] [instance: 34275f2e-8b70-44f1-826d-bff0192f8438] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:57.130000 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-92c0e203-ff1c-4b9f-8463-d94b7524c862 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:57.130533 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-92c0e203-ff1c-4b9f-8463-d94b7524c862 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:57.131571 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-92c0e203-ff1c-4b9f-8463-d94b7524c862 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:57.132147 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-92c0e203-ff1c-4b9f-8463-d94b7524c862 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:57.135204 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-5c4822e7-6f6f-499f-a000-e860cd05b1e5 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a46d18160148f3a48ef4887f6ec7da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6284f2b80524eb0a36ccebaedba767a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:57.147580 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-5c4822e7-6f6f-499f-a000-e860cd05b1e5 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "GET /compute/v2.1/servers/5d8fcb1f-fa8f-4a61-8e8b-77a64053ca3c" status: 200 len: 1515 microversion: 2.1 time: 0.984361 Feb 17 04:40:57.149326 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 328/644] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:56 2021] GET /compute/v2.1/servers/5d8fcb1f-fa8f-4a61-8e8b-77a64053ca3c => generated 1515 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:40:57.154740 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-dc350929-f173-4937-8ace-08894d3ba68e tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:57.155655 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-dc350929-f173-4937-8ace-08894d3ba68e tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] [instance: 9231f663-c4c6-4723-8d42-377d3f6dd031] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:57.165632 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-dc350929-f173-4937-8ace-08894d3ba68e tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:57.166735 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-dc350929-f173-4937-8ace-08894d3ba68e tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:57.167976 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-dc350929-f173-4937-8ace-08894d3ba68e tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:57.168670 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-dc350929-f173-4937-8ace-08894d3ba68e tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:58.041909 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-92c0e203-ff1c-4b9f-8463-d94b7524c862 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a3efaa75e64645abf7555ccfe348d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b23386679f44b7e9d4204ab1e9adf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:58.051372 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-92c0e203-ff1c-4b9f-8463-d94b7524c862 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] 10.222.0.38 "GET /compute/v2.1/servers/34275f2e-8b70-44f1-826d-bff0192f8438" status: 200 len: 1319 microversion: 2.1 time: 0.934287 Feb 17 04:40:58.051983 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 317/645] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:57 2021] GET /compute/v2.1/servers/34275f2e-8b70-44f1-826d-bff0192f8438 => generated 1319 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:40:58.056917 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-dc350929-f173-4937-8ace-08894d3ba68e tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190727a0bed54b52913aa6aa1ff8cea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57600d4d269474ab7d2f3e7ebf528ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:58.068139 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-dc350929-f173-4937-8ace-08894d3ba68e tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] 10.222.0.38 "GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031" status: 200 len: 1765 microversion: 2.1 time: 0.917519 Feb 17 04:40:58.068856 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 329/646] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:57 2021] GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031 => generated 1765 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:40:58.134009 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-b24b9173-0913-4765-b5be-13057b15c63a tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:58.134791 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-b24b9173-0913-4765-b5be-13057b15c63a tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 68a5c561-c418-4a68-b8b3-1600b638b80c] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:58.142682 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b24b9173-0913-4765-b5be-13057b15c63a tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:58.143212 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b24b9173-0913-4765-b5be-13057b15c63a tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:58.144119 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b24b9173-0913-4765-b5be-13057b15c63a tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:58.144616 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b24b9173-0913-4765-b5be-13057b15c63a tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:58.165858 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-d3b94157-ac41-41da-8bc4-fa28efd1105e tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:58.166526 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-d3b94157-ac41-41da-8bc4-fa28efd1105e tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: 5d8fcb1f-fa8f-4a61-8e8b-77a64053ca3c] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:58.174297 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d3b94157-ac41-41da-8bc4-fa28efd1105e tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:58.175543 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d3b94157-ac41-41da-8bc4-fa28efd1105e tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:58.176394 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d3b94157-ac41-41da-8bc4-fa28efd1105e tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:58.176881 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d3b94157-ac41-41da-8bc4-fa28efd1105e tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:58.380495 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-b24b9173-0913-4765-b5be-13057b15c63a tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6163f256863b4d51a3950fea5f517838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94a26ff4de24165a4a8fc5a5ddfd3f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:58.389534 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-b24b9173-0913-4765-b5be-13057b15c63a tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c" status: 200 len: 1480 microversion: 2.1 time: 0.259656 Feb 17 04:40:58.390241 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 318/647] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:58 2021] GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c => generated 1480 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:40:58.399852 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [req-607f365d-915e-4c7c-9f5d-f25dcba8b337 req-187d0567-d32e-443c-8a5d-da455bb26f23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d8fcb1f-fa8f-4a61-8e8b-77a64053ca3c", "name": "network-vif-unplugged", "status": "completed", "tag": "c45cb327-88cb-4944-9e37-27538a1aa3b5"}]} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:40:58.399852 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:40:58.399852 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:40:58.406879 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-607f365d-915e-4c7c-9f5d-f25dcba8b337 req-187d0567-d32e-443c-8a5d-da455bb26f23 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:58.407466 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-607f365d-915e-4c7c-9f5d-f25dcba8b337 req-187d0567-d32e-443c-8a5d-da455bb26f23 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:58.425954 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.compute.server_external_events [req-607f365d-915e-4c7c-9f5d-f25dcba8b337 req-187d0567-d32e-443c-8a5d-da455bb26f23 service nova] Creating event network-vif-unplugged:c45cb327-88cb-4944-9e37-27538a1aa3b5 for instance 5d8fcb1f-fa8f-4a61-8e8b-77a64053ca3c on hv-cinder-76019 Feb 17 04:40:58.432040 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [req-607f365d-915e-4c7c-9f5d-f25dcba8b337 req-187d0567-d32e-443c-8a5d-da455bb26f23 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040487 Feb 17 04:40:58.432911 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 319/648] 10.222.0.38 () {64 vars in 1308 bytes} [Wed Feb 17 04:40:58 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:40:58.518388 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [req-1f5ba9e4-21c1-4914-8a7d-e7ccfd4065a9 req-c47fb508-6100-4b14-acec-2cc401071207 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68a5c561-c418-4a68-b8b3-1600b638b80c", "name": "network-vif-deleted", "tag": "931d3091-bc84-4f99-9fec-11c4d1500c28"}]} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:40:58.520142 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:40:58.520142 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:40:58.529232 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-1f5ba9e4-21c1-4914-8a7d-e7ccfd4065a9 req-c47fb508-6100-4b14-acec-2cc401071207 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:58.529728 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-1f5ba9e4-21c1-4914-8a7d-e7ccfd4065a9 req-c47fb508-6100-4b14-acec-2cc401071207 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:58.547273 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.compute.server_external_events [req-1f5ba9e4-21c1-4914-8a7d-e7ccfd4065a9 req-c47fb508-6100-4b14-acec-2cc401071207 service nova] Creating event network-vif-deleted:931d3091-bc84-4f99-9fec-11c4d1500c28 for instance 68a5c561-c418-4a68-b8b3-1600b638b80c on hv-cinder-76019 Feb 17 04:40:58.553327 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [req-1f5ba9e4-21c1-4914-8a7d-e7ccfd4065a9 req-c47fb508-6100-4b14-acec-2cc401071207 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038932 Feb 17 04:40:58.553723 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 320/649] 10.222.0.38 () {64 vars in 1308 bytes} [Wed Feb 17 04:40:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:40:59.021697 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-d3b94157-ac41-41da-8bc4-fa28efd1105e tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a46d18160148f3a48ef4887f6ec7da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6284f2b80524eb0a36ccebaedba767a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:59.030657 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-d3b94157-ac41-41da-8bc4-fa28efd1105e tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "GET /compute/v2.1/servers/5d8fcb1f-fa8f-4a61-8e8b-77a64053ca3c" status: 200 len: 1515 microversion: 2.1 time: 0.868979 Feb 17 04:40:59.031449 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 330/650] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:58 2021] GET /compute/v2.1/servers/5d8fcb1f-fa8f-4a61-8e8b-77a64053ca3c => generated 1515 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:40:59.071025 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-ef620e08-49e7-4e48-a645-b979bd0f281f tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:59.072172 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-ef620e08-49e7-4e48-a645-b979bd0f281f tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] [instance: 34275f2e-8b70-44f1-826d-bff0192f8438] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:59.080801 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ef620e08-49e7-4e48-a645-b979bd0f281f tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:59.082800 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ef620e08-49e7-4e48-a645-b979bd0f281f tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:59.083884 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ef620e08-49e7-4e48-a645-b979bd0f281f tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:59.084597 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ef620e08-49e7-4e48-a645-b979bd0f281f tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:59.086083 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-7cd2ed9e-c485-44c9-96c9-c6c0047f0875 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:59.087323 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-7cd2ed9e-c485-44c9-96c9-c6c0047f0875 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] [instance: 9231f663-c4c6-4723-8d42-377d3f6dd031] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:59.095856 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7cd2ed9e-c485-44c9-96c9-c6c0047f0875 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:59.096405 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7cd2ed9e-c485-44c9-96c9-c6c0047f0875 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:59.108695 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7cd2ed9e-c485-44c9-96c9-c6c0047f0875 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:59.116498 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7cd2ed9e-c485-44c9-96c9-c6c0047f0875 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:59.434796 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-ef620e08-49e7-4e48-a645-b979bd0f281f tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a3efaa75e64645abf7555ccfe348d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b23386679f44b7e9d4204ab1e9adf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:59.444781 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-ef620e08-49e7-4e48-a645-b979bd0f281f tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] 10.222.0.38 "GET /compute/v2.1/servers/34275f2e-8b70-44f1-826d-bff0192f8438" status: 200 len: 1508 microversion: 2.1 time: 0.378937 Feb 17 04:40:59.445207 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 321/651] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:59 2021] GET /compute/v2.1/servers/34275f2e-8b70-44f1-826d-bff0192f8438 => generated 1508 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:40:59.448018 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-7cd2ed9e-c485-44c9-96c9-c6c0047f0875 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190727a0bed54b52913aa6aa1ff8cea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57600d4d269474ab7d2f3e7ebf528ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:40:59.449887 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-300ca93d-b9dc-4788-ad7f-be5af44047c1 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:40:59.450594 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-300ca93d-b9dc-4788-ad7f-be5af44047c1 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] [instance: 68a5c561-c418-4a68-b8b3-1600b638b80c] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:59.458214 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-300ca93d-b9dc-4788-ad7f-be5af44047c1 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:59.458736 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-7cd2ed9e-c485-44c9-96c9-c6c0047f0875 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] 10.222.0.38 "GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031" status: 200 len: 1765 microversion: 2.1 time: 0.377111 Feb 17 04:40:59.458873 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-300ca93d-b9dc-4788-ad7f-be5af44047c1 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:59.459633 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-300ca93d-b9dc-4788-ad7f-be5af44047c1 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:59.460127 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-300ca93d-b9dc-4788-ad7f-be5af44047c1 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:59.464578 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 331/652] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:59 2021] GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031 => generated 1765 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:40:59.471120 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-f8db8396-cfa1-4eba-8983-ad4517287434 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c2d0fd35-e142-423b-a8ca-d0c8fcc75bc0", "device": "/dev/sdb"}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:40:59.472711 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-f8db8396-cfa1-4eba-8983-ad4517287434 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] [instance: 34275f2e-8b70-44f1-826d-bff0192f8438] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:40:59.481036 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f8db8396-cfa1-4eba-8983-ad4517287434 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:59.481556 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f8db8396-cfa1-4eba-8983-ad4517287434 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:59.482453 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f8db8396-cfa1-4eba-8983-ad4517287434 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:40:59.483009 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f8db8396-cfa1-4eba-8983-ad4517287434 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:40:59.514380 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.wsgi [None req-300ca93d-b9dc-4788-ad7f-be5af44047c1 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] HTTP exception thrown: Instance 68a5c561-c418-4a68-b8b3-1600b638b80c could not be found. Feb 17 04:40:59.515045 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-300ca93d-b9dc-4788-ad7f-be5af44047c1 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] Returning 404 to user: Instance 68a5c561-c418-4a68-b8b3-1600b638b80c could not be found. {{(pid=98081) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:40:59.515950 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-300ca93d-b9dc-4788-ad7f-be5af44047c1 tempest-ServerRescueNegativeTestJSON-1377051355 tempest-ServerRescueNegativeTestJSON-1377051355-project] 10.222.0.38 "GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c" status: 404 len: 111 microversion: 2.1 time: 0.069758 Feb 17 04:40:59.516566 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 322/653] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:40:59 2021] GET /compute/v2.1/servers/68a5c561-c418-4a68-b8b3-1600b638b80c => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:40:59.909747 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-f8db8396-cfa1-4eba-8983-ad4517287434 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] 10.222.0.38 "POST /compute/v2.1/servers/34275f2e-8b70-44f1-826d-bff0192f8438/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.442716 Feb 17 04:40:59.912458 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 332/654] 10.222.0.38 () {60 vars in 1313 bytes} [Wed Feb 17 04:40:59 2021] POST /compute/v2.1/servers/34275f2e-8b70-44f1-826d-bff0192f8438/os-volume_attachments => generated 194 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:41:00.049264 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-f135dcec-5b39-4064-b46d-abd94756aee9 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:00.050246 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-f135dcec-5b39-4064-b46d-abd94756aee9 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: 5d8fcb1f-fa8f-4a61-8e8b-77a64053ca3c] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:00.058082 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f135dcec-5b39-4064-b46d-abd94756aee9 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:00.058628 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f135dcec-5b39-4064-b46d-abd94756aee9 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:00.060066 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f135dcec-5b39-4064-b46d-abd94756aee9 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:00.060336 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f135dcec-5b39-4064-b46d-abd94756aee9 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:00.118534 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.wsgi [None req-f135dcec-5b39-4064-b46d-abd94756aee9 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] HTTP exception thrown: Instance 5d8fcb1f-fa8f-4a61-8e8b-77a64053ca3c could not be found. Feb 17 04:41:00.119283 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-f135dcec-5b39-4064-b46d-abd94756aee9 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Returning 404 to user: Instance 5d8fcb1f-fa8f-4a61-8e8b-77a64053ca3c could not be found. {{(pid=98081) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:41:00.120578 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-f135dcec-5b39-4064-b46d-abd94756aee9 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "GET /compute/v2.1/servers/5d8fcb1f-fa8f-4a61-8e8b-77a64053ca3c" status: 404 len: 111 microversion: 2.1 time: 0.075231 Feb 17 04:41:00.121375 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 323/655] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:41:00 2021] GET /compute/v2.1/servers/5d8fcb1f-fa8f-4a61-8e8b-77a64053ca3c => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:41:00.479463 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-715d230e-7466-4617-bb7b-fc93e7251677 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:00.480302 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-715d230e-7466-4617-bb7b-fc93e7251677 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] [instance: 9231f663-c4c6-4723-8d42-377d3f6dd031] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:00.490480 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-715d230e-7466-4617-bb7b-fc93e7251677 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:00.491131 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-715d230e-7466-4617-bb7b-fc93e7251677 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:00.491983 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-715d230e-7466-4617-bb7b-fc93e7251677 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:00.492529 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-715d230e-7466-4617-bb7b-fc93e7251677 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:00.574889 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [req-1dd630bf-7c40-409f-9667-9120dfbe40c5 req-ef8ea9ec-20d3-47f3-8043-b0e519a2c64d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d8fcb1f-fa8f-4a61-8e8b-77a64053ca3c", "name": "network-vif-deleted", "tag": "c45cb327-88cb-4944-9e37-27538a1aa3b5"}]} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:41:00.576913 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:41:00.576913 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:41:00.586839 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-1dd630bf-7c40-409f-9667-9120dfbe40c5 req-ef8ea9ec-20d3-47f3-8043-b0e519a2c64d service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:00.587468 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-1dd630bf-7c40-409f-9667-9120dfbe40c5 req-ef8ea9ec-20d3-47f3-8043-b0e519a2c64d service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:00.605278 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.compute.server_external_events [req-1dd630bf-7c40-409f-9667-9120dfbe40c5 req-ef8ea9ec-20d3-47f3-8043-b0e519a2c64d service nova] Creating event network-vif-deleted:c45cb327-88cb-4944-9e37-27538a1aa3b5 for instance 5d8fcb1f-fa8f-4a61-8e8b-77a64053ca3c on hv-cinder-76019 Feb 17 04:41:00.610168 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [req-1dd630bf-7c40-409f-9667-9120dfbe40c5 req-ef8ea9ec-20d3-47f3-8043-b0e519a2c64d service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039303 Feb 17 04:41:00.610849 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 324/656] 10.222.0.38 () {64 vars in 1308 bytes} [Wed Feb 17 04:41:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:41:00.906406 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-715d230e-7466-4617-bb7b-fc93e7251677 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190727a0bed54b52913aa6aa1ff8cea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57600d4d269474ab7d2f3e7ebf528ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:00.916636 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-715d230e-7466-4617-bb7b-fc93e7251677 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] 10.222.0.38 "GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031" status: 200 len: 1765 microversion: 2.1 time: 0.442123 Feb 17 04:41:00.917249 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 333/657] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:41:00 2021] GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031 => generated 1765 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:41:01.383050 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-45d2397d-38ed-4d74-9354-d06e24430c23 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:01.383700 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-45d2397d-38ed-4d74-9354-d06e24430c23 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: 3ba4c3af-2d1e-4f4a-93e2-0e77d090962d] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:01.391704 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-45d2397d-38ed-4d74-9354-d06e24430c23 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:01.392210 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-45d2397d-38ed-4d74-9354-d06e24430c23 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:01.393042 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-45d2397d-38ed-4d74-9354-d06e24430c23 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:01.394180 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-45d2397d-38ed-4d74-9354-d06e24430c23 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:01.464194 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-45d2397d-38ed-4d74-9354-d06e24430c23 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: 3ba4c3af-2d1e-4f4a-93e2-0e77d090962d] Going to try to terminate instance {{(pid=98081) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 04:41:01.590911 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-45d2397d-38ed-4d74-9354-d06e24430c23 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "DELETE /compute/v2.1/servers/3ba4c3af-2d1e-4f4a-93e2-0e77d090962d" status: 204 len: 0 microversion: 2.1 time: 0.213295 Feb 17 04:41:01.594956 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 325/658] 10.222.0.38 () {58 vars in 1229 bytes} [Wed Feb 17 04:41:01 2021] DELETE /compute/v2.1/servers/3ba4c3af-2d1e-4f4a-93e2-0e77d090962d => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 17 04:41:01.600867 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-9c9eaae2-57d5-4db5-aa03-17ea4ea0c7fb tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:01.601548 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-9c9eaae2-57d5-4db5-aa03-17ea4ea0c7fb tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: 3ba4c3af-2d1e-4f4a-93e2-0e77d090962d] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:01.610271 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9c9eaae2-57d5-4db5-aa03-17ea4ea0c7fb tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:01.610829 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9c9eaae2-57d5-4db5-aa03-17ea4ea0c7fb tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:01.611693 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9c9eaae2-57d5-4db5-aa03-17ea4ea0c7fb tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:01.612760 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9c9eaae2-57d5-4db5-aa03-17ea4ea0c7fb tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:01.936192 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-f7a29edc-9515-4cea-98a0-b67be16640ce tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:01.936954 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-f7a29edc-9515-4cea-98a0-b67be16640ce tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] [instance: 9231f663-c4c6-4723-8d42-377d3f6dd031] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:01.945756 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f7a29edc-9515-4cea-98a0-b67be16640ce tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:01.946273 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f7a29edc-9515-4cea-98a0-b67be16640ce tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:01.947147 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f7a29edc-9515-4cea-98a0-b67be16640ce tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:01.947703 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f7a29edc-9515-4cea-98a0-b67be16640ce tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:02.081468 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-9c9eaae2-57d5-4db5-aa03-17ea4ea0c7fb tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a46d18160148f3a48ef4887f6ec7da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6284f2b80524eb0a36ccebaedba767a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:02.091906 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-9c9eaae2-57d5-4db5-aa03-17ea4ea0c7fb tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "GET /compute/v2.1/servers/3ba4c3af-2d1e-4f4a-93e2-0e77d090962d" status: 200 len: 1514 microversion: 2.1 time: 0.495701 Feb 17 04:41:02.092766 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 334/659] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:41:01 2021] GET /compute/v2.1/servers/3ba4c3af-2d1e-4f4a-93e2-0e77d090962d => generated 1514 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:41:02.457607 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-f7a29edc-9515-4cea-98a0-b67be16640ce tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190727a0bed54b52913aa6aa1ff8cea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57600d4d269474ab7d2f3e7ebf528ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:02.467833 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-f7a29edc-9515-4cea-98a0-b67be16640ce tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] 10.222.0.38 "GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031" status: 200 len: 1765 microversion: 2.1 time: 0.536380 Feb 17 04:41:02.468620 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 326/660] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:41:01 2021] GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031 => generated 1765 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:41:03.111708 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-b33389f1-dced-4977-ae91-3a5eb9b92459 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:03.112931 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-b33389f1-dced-4977-ae91-3a5eb9b92459 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: 3ba4c3af-2d1e-4f4a-93e2-0e77d090962d] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:03.123282 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b33389f1-dced-4977-ae91-3a5eb9b92459 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:03.124672 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b33389f1-dced-4977-ae91-3a5eb9b92459 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:03.125946 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b33389f1-dced-4977-ae91-3a5eb9b92459 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:03.126681 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b33389f1-dced-4977-ae91-3a5eb9b92459 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:03.488176 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-b2db3078-9ef0-4c2a-a66a-823dae7a949a tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:03.489030 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-b2db3078-9ef0-4c2a-a66a-823dae7a949a tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] [instance: 9231f663-c4c6-4723-8d42-377d3f6dd031] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:03.498283 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b2db3078-9ef0-4c2a-a66a-823dae7a949a tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:03.499161 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b2db3078-9ef0-4c2a-a66a-823dae7a949a tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:03.500425 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b2db3078-9ef0-4c2a-a66a-823dae7a949a tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:03.501240 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b2db3078-9ef0-4c2a-a66a-823dae7a949a tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:03.934822 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-b33389f1-dced-4977-ae91-3a5eb9b92459 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a46d18160148f3a48ef4887f6ec7da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6284f2b80524eb0a36ccebaedba767a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:03.944550 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-b33389f1-dced-4977-ae91-3a5eb9b92459 tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "GET /compute/v2.1/servers/3ba4c3af-2d1e-4f4a-93e2-0e77d090962d" status: 200 len: 1514 microversion: 2.1 time: 0.836671 Feb 17 04:41:03.945114 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 335/661] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:41:03 2021] GET /compute/v2.1/servers/3ba4c3af-2d1e-4f4a-93e2-0e77d090962d => generated 1514 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:41:04.392901 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-b2db3078-9ef0-4c2a-a66a-823dae7a949a tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190727a0bed54b52913aa6aa1ff8cea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57600d4d269474ab7d2f3e7ebf528ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:04.404438 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-b2db3078-9ef0-4c2a-a66a-823dae7a949a tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] 10.222.0.38 "GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031" status: 200 len: 1768 microversion: 2.1 time: 0.921079 Feb 17 04:41:04.409490 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 327/662] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:41:03 2021] GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031 => generated 1768 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:41:04.963418 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-c7c7ca5b-d08c-40a1-84df-dc35bf4e20da tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:04.964313 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-c7c7ca5b-d08c-40a1-84df-dc35bf4e20da tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: 3ba4c3af-2d1e-4f4a-93e2-0e77d090962d] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:04.976292 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c7c7ca5b-d08c-40a1-84df-dc35bf4e20da tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:04.976795 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c7c7ca5b-d08c-40a1-84df-dc35bf4e20da tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:04.977637 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c7c7ca5b-d08c-40a1-84df-dc35bf4e20da tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:04.978127 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c7c7ca5b-d08c-40a1-84df-dc35bf4e20da tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:05.813041 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-c7c7ca5b-d08c-40a1-84df-dc35bf4e20da tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a46d18160148f3a48ef4887f6ec7da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6284f2b80524eb0a36ccebaedba767a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:05.822885 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-c7c7ca5b-d08c-40a1-84df-dc35bf4e20da tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "GET /compute/v2.1/servers/3ba4c3af-2d1e-4f4a-93e2-0e77d090962d" status: 200 len: 1514 microversion: 2.1 time: 0.863396 Feb 17 04:41:05.823481 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 336/663] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:41:04 2021] GET /compute/v2.1/servers/3ba4c3af-2d1e-4f4a-93e2-0e77d090962d => generated 1514 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:41:05.896925 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [req-339ac8ea-64a1-4ff0-881c-09aa9f854fbc req-dcfa353d-6a9d-46d3-bc2d-afc71f3f76a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ba4c3af-2d1e-4f4a-93e2-0e77d090962d", "name": "network-vif-deleted", "tag": "d92a1575-fc75-4375-9949-9d1f0f507388"}]} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:41:05.898859 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:41:05.898859 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:41:05.910048 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-339ac8ea-64a1-4ff0-881c-09aa9f854fbc req-dcfa353d-6a9d-46d3-bc2d-afc71f3f76a4 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:05.910675 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-339ac8ea-64a1-4ff0-881c-09aa9f854fbc req-dcfa353d-6a9d-46d3-bc2d-afc71f3f76a4 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:05.928814 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.compute.server_external_events [req-339ac8ea-64a1-4ff0-881c-09aa9f854fbc req-dcfa353d-6a9d-46d3-bc2d-afc71f3f76a4 service nova] Creating event network-vif-deleted:d92a1575-fc75-4375-9949-9d1f0f507388 for instance 3ba4c3af-2d1e-4f4a-93e2-0e77d090962d on hv-cinder-76019 Feb 17 04:41:05.933686 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [req-339ac8ea-64a1-4ff0-881c-09aa9f854fbc req-dcfa353d-6a9d-46d3-bc2d-afc71f3f76a4 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041530 Feb 17 04:41:05.934851 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 328/664] 10.222.0.38 () {64 vars in 1308 bytes} [Wed Feb 17 04:41:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:41:06.841577 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-826d5432-952a-4456-892d-8858eef048af tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:06.842232 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-826d5432-952a-4456-892d-8858eef048af tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] [instance: 3ba4c3af-2d1e-4f4a-93e2-0e77d090962d] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:06.851087 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-826d5432-952a-4456-892d-8858eef048af tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:06.851599 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-826d5432-952a-4456-892d-8858eef048af tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:06.852443 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-826d5432-952a-4456-892d-8858eef048af tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:06.853058 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-826d5432-952a-4456-892d-8858eef048af tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:06.906534 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.wsgi [None req-826d5432-952a-4456-892d-8858eef048af tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] HTTP exception thrown: Instance 3ba4c3af-2d1e-4f4a-93e2-0e77d090962d could not be found. Feb 17 04:41:06.907173 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-826d5432-952a-4456-892d-8858eef048af tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] Returning 404 to user: Instance 3ba4c3af-2d1e-4f4a-93e2-0e77d090962d could not be found. {{(pid=98080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:41:06.908086 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-826d5432-952a-4456-892d-8858eef048af tempest-AttachVolumeNegativeTest-2117952896 tempest-AttachVolumeNegativeTest-2117952896-project] 10.222.0.38 "GET /compute/v2.1/servers/3ba4c3af-2d1e-4f4a-93e2-0e77d090962d" status: 404 len: 111 microversion: 2.1 time: 0.070632 Feb 17 04:41:06.912840 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 337/665] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:41:06 2021] GET /compute/v2.1/servers/3ba4c3af-2d1e-4f4a-93e2-0e77d090962d => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:41:22.463755 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-69693597-4e2a-4ebe-8575-027ea8bd9be5 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:22.464460 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-69693597-4e2a-4ebe-8575-027ea8bd9be5 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] [instance: 34275f2e-8b70-44f1-826d-bff0192f8438] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:22.473935 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-69693597-4e2a-4ebe-8575-027ea8bd9be5 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:22.474650 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-69693597-4e2a-4ebe-8575-027ea8bd9be5 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:22.475838 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-69693597-4e2a-4ebe-8575-027ea8bd9be5 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:22.476331 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-69693597-4e2a-4ebe-8575-027ea8bd9be5 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:22.958425 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.objects.instance [None req-69693597-4e2a-4ebe-8575-027ea8bd9be5 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lazy-loading 'services' on Instance uuid 34275f2e-8b70-44f1-826d-bff0192f8438 {{(pid=98081) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:41:23.101569 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-69693597-4e2a-4ebe-8575-027ea8bd9be5 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] 10.222.0.38 "DELETE /compute/v2.1/servers/34275f2e-8b70-44f1-826d-bff0192f8438/os-volume_attachments/c2d0fd35-e142-423b-a8ca-d0c8fcc75bc0" status: 202 len: 0 microversion: 2.1 time: 0.642048 Feb 17 04:41:23.102226 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 329/666] 10.222.0.38 () {58 vars in 1406 bytes} [Wed Feb 17 04:41:22 2021] DELETE /compute/v2.1/servers/34275f2e-8b70-44f1-826d-bff0192f8438/os-volume_attachments/c2d0fd35-e142-423b-a8ca-d0c8fcc75bc0 => generated 0 bytes in 644 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:41:24.324521 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-e9f4d984-b048-41d5-b367-a1a913c84fef tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:24.325081 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-e9f4d984-b048-41d5-b367-a1a913c84fef tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] [instance: 34275f2e-8b70-44f1-826d-bff0192f8438] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:24.334211 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e9f4d984-b048-41d5-b367-a1a913c84fef tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:24.334978 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e9f4d984-b048-41d5-b367-a1a913c84fef tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:24.336035 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e9f4d984-b048-41d5-b367-a1a913c84fef tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:24.336537 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e9f4d984-b048-41d5-b367-a1a913c84fef tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:24.402894 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-e9f4d984-b048-41d5-b367-a1a913c84fef tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] [instance: 34275f2e-8b70-44f1-826d-bff0192f8438] Going to try to terminate instance {{(pid=98080) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 04:41:24.531412 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-e9f4d984-b048-41d5-b367-a1a913c84fef tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] 10.222.0.38 "DELETE /compute/v2.1/servers/34275f2e-8b70-44f1-826d-bff0192f8438" status: 204 len: 0 microversion: 2.1 time: 0.210048 Feb 17 04:41:24.532355 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 338/667] 10.222.0.38 () {58 vars in 1229 bytes} [Wed Feb 17 04:41:24 2021] DELETE /compute/v2.1/servers/34275f2e-8b70-44f1-826d-bff0192f8438 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 17 04:41:24.542950 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-7a2ef9c3-6f6d-4df1-91d7-fc40e6965f9c tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:24.543587 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-7a2ef9c3-6f6d-4df1-91d7-fc40e6965f9c tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] [instance: 34275f2e-8b70-44f1-826d-bff0192f8438] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:24.553944 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7a2ef9c3-6f6d-4df1-91d7-fc40e6965f9c tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:24.555174 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7a2ef9c3-6f6d-4df1-91d7-fc40e6965f9c tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:24.556870 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7a2ef9c3-6f6d-4df1-91d7-fc40e6965f9c tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:24.557529 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7a2ef9c3-6f6d-4df1-91d7-fc40e6965f9c tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:24.788808 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-7a2ef9c3-6f6d-4df1-91d7-fc40e6965f9c tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a3efaa75e64645abf7555ccfe348d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b23386679f44b7e9d4204ab1e9adf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:24.798337 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-7a2ef9c3-6f6d-4df1-91d7-fc40e6965f9c tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] 10.222.0.38 "GET /compute/v2.1/servers/34275f2e-8b70-44f1-826d-bff0192f8438" status: 200 len: 1514 microversion: 2.1 time: 0.260569 Feb 17 04:41:24.803927 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 330/668] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:41:24 2021] GET /compute/v2.1/servers/34275f2e-8b70-44f1-826d-bff0192f8438 => generated 1514 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:41:25.819473 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-10bf266d-0ad1-4fa9-bd49-1f7f9fe9a0b3 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:25.820252 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-10bf266d-0ad1-4fa9-bd49-1f7f9fe9a0b3 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] [instance: 34275f2e-8b70-44f1-826d-bff0192f8438] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:25.838146 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-10bf266d-0ad1-4fa9-bd49-1f7f9fe9a0b3 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:25.838683 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-10bf266d-0ad1-4fa9-bd49-1f7f9fe9a0b3 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:25.839548 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-10bf266d-0ad1-4fa9-bd49-1f7f9fe9a0b3 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:25.840046 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-10bf266d-0ad1-4fa9-bd49-1f7f9fe9a0b3 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:26.067325 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 17 04:41:26.067560 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: Wed Feb 17 04:41:26 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/34275f2e-8b70-44f1-826d-bff0192f8438 (ip 10.222.0.38) !!! Feb 17 04:41:26.562383 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-10bf266d-0ad1-4fa9-bd49-1f7f9fe9a0b3 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a3efaa75e64645abf7555ccfe348d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b23386679f44b7e9d4204ab1e9adf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:26.572298 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-10bf266d-0ad1-4fa9-bd49-1f7f9fe9a0b3 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] 10.222.0.38 "GET /compute/v2.1/servers/34275f2e-8b70-44f1-826d-bff0192f8438" status: 200 len: 1514 microversion: 2.1 time: 0.758296 Feb 17 04:41:26.573145 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 339/669] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:41:25 2021] GET /compute/v2.1/servers/34275f2e-8b70-44f1-826d-bff0192f8438 => generated 1514 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:41:27.578798 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [req-0a154d57-2b3b-4c5e-b08e-e912cc8c775c req-dc938dd5-3b04-4deb-8832-e74475d81549 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34275f2e-8b70-44f1-826d-bff0192f8438", "name": "network-vif-deleted", "tag": "e2e0a4b5-c176-4366-a4c5-3191ea792497"}]} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:41:27.581700 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:41:27.581700 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:41:27.595058 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-f79f4eac-7e33-4e7f-a5bf-efdff5a30b38 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:27.596457 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-f79f4eac-7e33-4e7f-a5bf-efdff5a30b38 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] [instance: 34275f2e-8b70-44f1-826d-bff0192f8438] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:27.608624 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f79f4eac-7e33-4e7f-a5bf-efdff5a30b38 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:27.609654 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f79f4eac-7e33-4e7f-a5bf-efdff5a30b38 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:27.609812 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-0a154d57-2b3b-4c5e-b08e-e912cc8c775c req-dc938dd5-3b04-4deb-8832-e74475d81549 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:27.610347 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-0a154d57-2b3b-4c5e-b08e-e912cc8c775c req-dc938dd5-3b04-4deb-8832-e74475d81549 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:27.611892 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f79f4eac-7e33-4e7f-a5bf-efdff5a30b38 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:27.626267 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f79f4eac-7e33-4e7f-a5bf-efdff5a30b38 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:27.630260 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.compute.server_external_events [req-0a154d57-2b3b-4c5e-b08e-e912cc8c775c req-dc938dd5-3b04-4deb-8832-e74475d81549 service nova] Creating event network-vif-deleted:e2e0a4b5-c176-4366-a4c5-3191ea792497 for instance 34275f2e-8b70-44f1-826d-bff0192f8438 on hv-cinder-76019 Feb 17 04:41:27.635638 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [req-0a154d57-2b3b-4c5e-b08e-e912cc8c775c req-dc938dd5-3b04-4deb-8832-e74475d81549 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060889 Feb 17 04:41:27.636323 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 331/670] 10.222.0.38 () {64 vars in 1308 bytes} [Wed Feb 17 04:41:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:41:27.821694 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-f79f4eac-7e33-4e7f-a5bf-efdff5a30b38 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a3efaa75e64645abf7555ccfe348d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b23386679f44b7e9d4204ab1e9adf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:27.831328 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-f79f4eac-7e33-4e7f-a5bf-efdff5a30b38 tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] 10.222.0.38 "GET /compute/v2.1/servers/34275f2e-8b70-44f1-826d-bff0192f8438" status: 200 len: 1304 microversion: 2.1 time: 0.240476 Feb 17 04:41:27.831928 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 340/671] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:41:27 2021] GET /compute/v2.1/servers/34275f2e-8b70-44f1-826d-bff0192f8438 => generated 1304 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:41:28.852521 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-6ae156f3-5b58-46de-9ebb-318a25031a0d tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:28.853494 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-6ae156f3-5b58-46de-9ebb-318a25031a0d tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] [instance: 34275f2e-8b70-44f1-826d-bff0192f8438] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:28.865113 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6ae156f3-5b58-46de-9ebb-318a25031a0d tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:28.865578 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6ae156f3-5b58-46de-9ebb-318a25031a0d tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:28.866442 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6ae156f3-5b58-46de-9ebb-318a25031a0d tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:28.867112 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6ae156f3-5b58-46de-9ebb-318a25031a0d tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:28.923465 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.wsgi [None req-6ae156f3-5b58-46de-9ebb-318a25031a0d tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] HTTP exception thrown: Instance 34275f2e-8b70-44f1-826d-bff0192f8438 could not be found. Feb 17 04:41:28.924725 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-6ae156f3-5b58-46de-9ebb-318a25031a0d tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] Returning 404 to user: Instance 34275f2e-8b70-44f1-826d-bff0192f8438 could not be found. {{(pid=98081) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:41:28.925838 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-6ae156f3-5b58-46de-9ebb-318a25031a0d tempest-VolumesSnapshotTestJSON-1778706442 tempest-VolumesSnapshotTestJSON-1778706442-project] 10.222.0.38 "GET /compute/v2.1/servers/34275f2e-8b70-44f1-826d-bff0192f8438" status: 404 len: 111 microversion: 2.1 time: 0.080495 Feb 17 04:41:28.926457 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 332/672] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:41:28 2021] GET /compute/v2.1/servers/34275f2e-8b70-44f1-826d-bff0192f8438 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:41:34.934955 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-5e7f1c9c-7c58-488a-b6dc-42c3baf10e70 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:34.935585 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-5e7f1c9c-7c58-488a-b6dc-42c3baf10e70 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:34.947414 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5e7f1c9c-7c58-488a-b6dc-42c3baf10e70 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:34.947414 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5e7f1c9c-7c58-488a-b6dc-42c3baf10e70 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:34.947414 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5e7f1c9c-7c58-488a-b6dc-42c3baf10e70 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:34.947414 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5e7f1c9c-7c58-488a-b6dc-42c3baf10e70 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:35.020006 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-5e7f1c9c-7c58-488a-b6dc-42c3baf10e70 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/os-volume_attachments/d9ec2079-3156-4746-b77b-d25831427498" status: 200 len: 194 microversion: 2.20 time: 0.089403 Feb 17 04:41:35.020518 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 341/673] 10.222.0.38 () {60 vars in 1444 bytes} [Wed Feb 17 04:41:34 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/os-volume_attachments/d9ec2079-3156-4746-b77b-d25831427498 => generated 194 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:41:35.170182 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-84978ab3-a66b-49d3-9af2-020f07de5afe tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:35.170762 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-84978ab3-a66b-49d3-9af2-020f07de5afe tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:35.179184 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-84978ab3-a66b-49d3-9af2-020f07de5afe tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:35.179691 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-84978ab3-a66b-49d3-9af2-020f07de5afe tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:35.180547 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-84978ab3-a66b-49d3-9af2-020f07de5afe tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:35.181044 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-84978ab3-a66b-49d3-9af2-020f07de5afe tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:35.364137 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.objects.instance [None req-84978ab3-a66b-49d3-9af2-020f07de5afe tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lazy-loading 'services' on Instance uuid 8d9c77fb-c4b1-4b48-a00a-b85af63c8920 {{(pid=98081) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:41:35.524306 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-84978ab3-a66b-49d3-9af2-020f07de5afe tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "DELETE /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/os-volume_attachments/d9ec2079-3156-4746-b77b-d25831427498" status: 202 len: 0 microversion: 2.20 time: 0.357992 Feb 17 04:41:35.524939 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 333/674] 10.222.0.38 () {60 vars in 1447 bytes} [Wed Feb 17 04:41:35 2021] DELETE /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920/os-volume_attachments/d9ec2079-3156-4746-b77b-d25831427498 => generated 0 bytes in 360 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 17 04:41:36.871095 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-76857b5f-ed32-4d95-b8a7-ca908fbd5c8e tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:36.871908 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-76857b5f-ed32-4d95-b8a7-ca908fbd5c8e tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:36.880749 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-76857b5f-ed32-4d95-b8a7-ca908fbd5c8e tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:36.881389 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-76857b5f-ed32-4d95-b8a7-ca908fbd5c8e tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:36.882446 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-76857b5f-ed32-4d95-b8a7-ca908fbd5c8e tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:36.883063 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-76857b5f-ed32-4d95-b8a7-ca908fbd5c8e tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:36.974926 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-76857b5f-ed32-4d95-b8a7-ca908fbd5c8e tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Going to try to terminate instance {{(pid=98080) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 04:41:37.098043 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-76857b5f-ed32-4d95-b8a7-ca908fbd5c8e tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "DELETE /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 204 len: 0 microversion: 2.20 time: 0.230745 Feb 17 04:41:37.101845 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 342/675] 10.222.0.38 () {60 vars in 1270 bytes} [Wed Feb 17 04:41:36 2021] DELETE /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 17 04:41:37.107695 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-4b4e490e-7a94-4f65-b5ce-325658d1da52 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:37.108458 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-4b4e490e-7a94-4f65-b5ce-325658d1da52 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:37.118536 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4b4e490e-7a94-4f65-b5ce-325658d1da52 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:37.119080 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4b4e490e-7a94-4f65-b5ce-325658d1da52 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:37.120508 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4b4e490e-7a94-4f65-b5ce-325658d1da52 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:37.120992 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4b4e490e-7a94-4f65-b5ce-325658d1da52 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:37.349167 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-4b4e490e-7a94-4f65-b5ce-325658d1da52 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:37.359621 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-4b4e490e-7a94-4f65-b5ce-325658d1da52 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:37.361367 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-4b4e490e-7a94-4f65-b5ce-325658d1da52 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:37.362601 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-4b4e490e-7a94-4f65-b5ce-325658d1da52 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1725 microversion: 2.20 time: 0.259309 Feb 17 04:41:37.363363 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 334/676] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:41:37 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1725 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 04:41:38.385994 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-4fa623a5-f449-492b-9516-de250d6bab70 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:38.386781 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-4fa623a5-f449-492b-9516-de250d6bab70 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:38.394926 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4fa623a5-f449-492b-9516-de250d6bab70 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:38.395444 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4fa623a5-f449-492b-9516-de250d6bab70 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:38.396301 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4fa623a5-f449-492b-9516-de250d6bab70 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:38.396804 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4fa623a5-f449-492b-9516-de250d6bab70 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:38.653904 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-4fa623a5-f449-492b-9516-de250d6bab70 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:38.671831 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-4fa623a5-f449-492b-9516-de250d6bab70 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:38.673667 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-4fa623a5-f449-492b-9516-de250d6bab70 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:38.675150 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-4fa623a5-f449-492b-9516-de250d6bab70 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1725 microversion: 2.20 time: 0.294765 Feb 17 04:41:38.687194 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 343/677] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:41:38 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1725 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:41:39.345705 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [req-7aec4dff-33ad-45ba-9f0b-a2a4734a6703 req-9fc7fdd2-5c11-4180-80dc-ce137e37d45c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d9c77fb-c4b1-4b48-a00a-b85af63c8920", "name": "network-vif-unplugged", "status": "completed", "tag": "f8a409c8-c8d0-47e0-b35c-7b5830e57e6e"}]} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:41:39.347607 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:41:39.347607 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:41:39.366281 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-7aec4dff-33ad-45ba-9f0b-a2a4734a6703 req-9fc7fdd2-5c11-4180-80dc-ce137e37d45c service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:39.366851 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-7aec4dff-33ad-45ba-9f0b-a2a4734a6703 req-9fc7fdd2-5c11-4180-80dc-ce137e37d45c service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:39.389582 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.compute.server_external_events [req-7aec4dff-33ad-45ba-9f0b-a2a4734a6703 req-9fc7fdd2-5c11-4180-80dc-ce137e37d45c service nova] Creating event network-vif-unplugged:f8a409c8-c8d0-47e0-b35c-7b5830e57e6e for instance 8d9c77fb-c4b1-4b48-a00a-b85af63c8920 on hv-cinder-76019 Feb 17 04:41:39.396478 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [req-7aec4dff-33ad-45ba-9f0b-a2a4734a6703 req-9fc7fdd2-5c11-4180-80dc-ce137e37d45c service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055130 Feb 17 04:41:39.397160 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 335/678] 10.222.0.38 () {64 vars in 1308 bytes} [Wed Feb 17 04:41:39 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:41:39.696335 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-b06b7494-be9a-4b28-b339-30b9a8a1ad8b tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:39.696999 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-b06b7494-be9a-4b28-b339-30b9a8a1ad8b tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:39.705395 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b06b7494-be9a-4b28-b339-30b9a8a1ad8b tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:39.706399 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b06b7494-be9a-4b28-b339-30b9a8a1ad8b tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:39.707342 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b06b7494-be9a-4b28-b339-30b9a8a1ad8b tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:39.707743 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b06b7494-be9a-4b28-b339-30b9a8a1ad8b tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:40.149756 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-b06b7494-be9a-4b28-b339-30b9a8a1ad8b tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:40.162011 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-b06b7494-be9a-4b28-b339-30b9a8a1ad8b tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:40.163791 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-b06b7494-be9a-4b28-b339-30b9a8a1ad8b tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:40.166009 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-b06b7494-be9a-4b28-b339-30b9a8a1ad8b tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1725 microversion: 2.20 time: 0.473228 Feb 17 04:41:40.167312 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 344/679] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:41:39 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1725 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:41:41.187237 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-adce8fe0-3294-41d1-a00f-ce9cc7068621 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:41.189195 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-adce8fe0-3294-41d1-a00f-ce9cc7068621 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:41.200418 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-adce8fe0-3294-41d1-a00f-ce9cc7068621 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:41.201189 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-adce8fe0-3294-41d1-a00f-ce9cc7068621 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:41.203205 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-adce8fe0-3294-41d1-a00f-ce9cc7068621 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:41.204049 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-adce8fe0-3294-41d1-a00f-ce9cc7068621 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:41.959064 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-adce8fe0-3294-41d1-a00f-ce9cc7068621 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:41.974130 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-adce8fe0-3294-41d1-a00f-ce9cc7068621 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:41.976982 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-adce8fe0-3294-41d1-a00f-ce9cc7068621 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:41.982338 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-adce8fe0-3294-41d1-a00f-ce9cc7068621 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1725 microversion: 2.20 time: 0.800502 Feb 17 04:41:41.984352 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 336/680] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:41:41 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1725 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:41:42.631560 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [req-c8167c6a-4dec-414f-8669-ec6e7657c688 req-bee91c63-06cc-40d8-bdb3-12eb7c36d863 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d9c77fb-c4b1-4b48-a00a-b85af63c8920", "name": "network-vif-deleted", "tag": "f8a409c8-c8d0-47e0-b35c-7b5830e57e6e"}]} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:41:42.633460 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:41:42.633460 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:41:42.642796 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-c8167c6a-4dec-414f-8669-ec6e7657c688 req-bee91c63-06cc-40d8-bdb3-12eb7c36d863 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:42.643301 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-c8167c6a-4dec-414f-8669-ec6e7657c688 req-bee91c63-06cc-40d8-bdb3-12eb7c36d863 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:42.661955 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.compute.server_external_events [req-c8167c6a-4dec-414f-8669-ec6e7657c688 req-bee91c63-06cc-40d8-bdb3-12eb7c36d863 service nova] Creating event network-vif-deleted:f8a409c8-c8d0-47e0-b35c-7b5830e57e6e for instance 8d9c77fb-c4b1-4b48-a00a-b85af63c8920 on hv-cinder-76019 Feb 17 04:41:42.667629 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [req-c8167c6a-4dec-414f-8669-ec6e7657c688 req-bee91c63-06cc-40d8-bdb3-12eb7c36d863 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039939 Feb 17 04:41:42.668466 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 345/681] 10.222.0.38 () {64 vars in 1308 bytes} [Wed Feb 17 04:41:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:41:43.004250 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-50388502-dd78-403f-835c-d0c37603b613 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:43.005207 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-50388502-dd78-403f-835c-d0c37603b613 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:43.014148 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-50388502-dd78-403f-835c-d0c37603b613 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:43.015079 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-50388502-dd78-403f-835c-d0c37603b613 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:43.016089 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-50388502-dd78-403f-835c-d0c37603b613 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:43.016756 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-50388502-dd78-403f-835c-d0c37603b613 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:43.157100 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-50388502-dd78-403f-835c-d0c37603b613 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:43.168056 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-50388502-dd78-403f-835c-d0c37603b613 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:43.170275 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-50388502-dd78-403f-835c-d0c37603b613 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:43.171988 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-50388502-dd78-403f-835c-d0c37603b613 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 200 len: 1657 microversion: 2.20 time: 0.172065 Feb 17 04:41:43.173782 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 337/682] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:41:42 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 1657 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:41:44.193660 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-d748a9c5-0d82-4081-8178-d0b8b2b068db tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:44.194420 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-d748a9c5-0d82-4081-8178-d0b8b2b068db tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:44.202908 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d748a9c5-0d82-4081-8178-d0b8b2b068db tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:44.203420 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d748a9c5-0d82-4081-8178-d0b8b2b068db tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:44.204373 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d748a9c5-0d82-4081-8178-d0b8b2b068db tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:44.204874 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d748a9c5-0d82-4081-8178-d0b8b2b068db tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:44.260329 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.wsgi [None req-d748a9c5-0d82-4081-8178-d0b8b2b068db tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] HTTP exception thrown: Instance 8d9c77fb-c4b1-4b48-a00a-b85af63c8920 could not be found. Feb 17 04:41:44.261250 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-d748a9c5-0d82-4081-8178-d0b8b2b068db tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Returning 404 to user: Instance 8d9c77fb-c4b1-4b48-a00a-b85af63c8920 could not be found. {{(pid=98080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:41:44.262531 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-d748a9c5-0d82-4081-8178-d0b8b2b068db tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 404 len: 111 microversion: 2.20 time: 0.073488 Feb 17 04:41:44.263397 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 346/683] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:41:44 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 17 04:41:44.272699 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-ff48d00e-58ca-4d80-b1f1-49f2425683e0 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '.version_select at 0x7fc2e9d5b268>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:44.290694 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-ff48d00e-58ca-4d80-b1f1-49f2425683e0 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1955402104" status: 204 len: 0 microversion: 2.20 time: 0.021939 Feb 17 04:41:44.291306 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 338/684] 10.222.0.38 () {60 vars in 1252 bytes} [Wed Feb 17 04:41:44 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1955402104 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 17 04:41:45.606999 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-d075ec42-25e2-4d56-a3f6-263d7a73487c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Action: 'create', calling method: .version_select at 0x7fc2ee9ee1e0>, body: {"keypair": {"name": "tempest-keypair-2123527321"}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:41:45.635557 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.quota [None req-d075ec42-25e2-4d56-a3f6-263d7a73487c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Getting quotas for project 669aa7253aff4985a447b249c23aa338. Resources: {'key_pairs'} {{(pid=98080) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:41:45.639726 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.quota [None req-d075ec42-25e2-4d56-a3f6-263d7a73487c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Getting quotas for user 24b1af7d956f42a19ef0e6a9a753b2bd and project 669aa7253aff4985a447b249c23aa338. Resources: {'key_pairs'} {{(pid=98080) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:41:45.903006 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.quota [None req-d075ec42-25e2-4d56-a3f6-263d7a73487c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Getting quotas for project 669aa7253aff4985a447b249c23aa338. Resources: {'key_pairs'} {{(pid=98080) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:41:45.906977 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.quota [None req-d075ec42-25e2-4d56-a3f6-263d7a73487c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Getting quotas for user 24b1af7d956f42a19ef0e6a9a753b2bd and project 669aa7253aff4985a447b249c23aa338. Resources: {'key_pairs'} {{(pid=98080) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:41:45.921403 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-d075ec42-25e2-4d56-a3f6-263d7a73487c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.318414 Feb 17 04:41:45.922059 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 347/685] 10.222.0.38 () {62 vars in 1189 bytes} [Wed Feb 17 04:41:45 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 320 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Feb 17 04:41:48.028343 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-59f199a9-f9e4-42ff-830d-c7dff7d67325 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-TestMinimumBasicScenario-1389943885"}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:41:48.028925 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-59f199a9-f9e4-42ff-830d-c7dff7d67325 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] [instance: 9231f663-c4c6-4723-8d42-377d3f6dd031] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:48.037357 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-59f199a9-f9e4-42ff-830d-c7dff7d67325 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:48.037879 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-59f199a9-f9e4-42ff-830d-c7dff7d67325 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:48.038752 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-59f199a9-f9e4-42ff-830d-c7dff7d67325 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:48.039256 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-59f199a9-f9e4-42ff-830d-c7dff7d67325 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:48.359731 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.network.security_group_api [None req-59f199a9-f9e4-42ff-830d-c7dff7d67325 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Removing security group 982665c9-67b2-41e8-a6c8-2cc22a829360 from port 8c40a9f8-0504-4483-9e26-48a5210a4191 Feb 17 04:41:48.465532 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-60177387-fc9f-492a-a6a4-0bc38c43e972 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1957796862", "imageRef": "2d6991a7-a1f0-444b-8fd5-d05558b5f9a4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cee8cd42-e9ee-4d26-a68b-5f13a2055c3a"}], "security_groups": [{"name": "tempest-securitygroup--626609980"}], "key_name": "tempest-keypair-2123527321", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:41:48.718194 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.network.neutron [None req-60177387-fc9f-492a-a6a4-0bc38c43e972 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] validate_networks() for [('cee8cd42-e9ee-4d26-a68b-5f13a2055c3a', None, None, None)] {{(pid=98080) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 04:41:49.396063 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-59f199a9-f9e4-42ff-830d-c7dff7d67325 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] 10.222.0.38 "POST /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031/action" status: 202 len: 0 microversion: 2.1 time: 1.371797 Feb 17 04:41:49.396737 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 339/686] 10.222.0.38 () {60 vars in 1268 bytes} [Wed Feb 17 04:41:48 2021] POST /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031/action => generated 0 bytes in 1373 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:41:49.405462 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-f1d7136e-0da6-40fa-8df8-bdc8bdbec689 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Calling method '.version_select at 0x7fc2ea9f00d0>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:49.929559 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-60177387-fc9f-492a-a6a4-0bc38c43e972 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Flavor limits 0:0:0 {{(pid=98080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 04:41:49.930033 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-60177387-fc9f-492a-a6a4-0bc38c43e972 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Image limits 0:0:0 {{(pid=98080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 04:41:49.930606 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-60177387-fc9f-492a-a6a4-0bc38c43e972 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Flavor pref 0:0:0 {{(pid=98080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 04:41:49.931063 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-60177387-fc9f-492a-a6a4-0bc38c43e972 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Image pref 0:0:0 {{(pid=98080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 04:41:49.931529 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-60177387-fc9f-492a-a6a4-0bc38c43e972 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 04:41:49.943060 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-60177387-fc9f-492a-a6a4-0bc38c43e972 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:49.943575 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-60177387-fc9f-492a-a6a4-0bc38c43e972 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:49.944460 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-60177387-fc9f-492a-a6a4-0bc38c43e972 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:49.945082 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-f1d7136e-0da6-40fa-8df8-bdc8bdbec689 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] 10.222.0.38 "DELETE /compute/v2.1/os-security-groups/982665c9-67b2-41e8-a6c8-2cc22a829360" status: 202 len: 0 microversion: 2.1 time: 0.543643 Feb 17 04:41:49.945827 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 340/687] 10.222.0.38 () {58 vars in 1262 bytes} [Wed Feb 17 04:41:49 2021] DELETE /compute/v2.1/os-security-groups/982665c9-67b2-41e8-a6c8-2cc22a829360 => generated 0 bytes in 545 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:41:49.962604 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-60177387-fc9f-492a-a6a4-0bc38c43e972 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:49.984478 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.quota [None req-60177387-fc9f-492a-a6a4-0bc38c43e972 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Getting quotas for project 669aa7253aff4985a447b249c23aa338. Resources: {'instances', 'cores', 'ram'} {{(pid=98080) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:41:49.989382 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.quota [None req-60177387-fc9f-492a-a6a4-0bc38c43e972 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Getting quotas for user 24b1af7d956f42a19ef0e6a9a753b2bd and project 669aa7253aff4985a447b249c23aa338. Resources: {'instances', 'cores', 'ram'} {{(pid=98080) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:41:50.000632 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-60177387-fc9f-492a-a6a4-0bc38c43e972 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Going to run 1 instances... {{(pid=98080) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 04:41:50.003553 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-60177387-fc9f-492a-a6a4-0bc38c43e972 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d6991a7-a1f0-444b-8fd5-d05558b5f9a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98080) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 04:41:50.056205 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-60177387-fc9f-492a-a6a4-0bc38c43e972 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.595156 Feb 17 04:41:50.062880 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 348/688] 10.222.0.38 () {62 vars in 1178 bytes} [Wed Feb 17 04:41:48 2021] POST /compute/v2.1/servers => generated 401 bytes in 1597 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Feb 17 04:41:50.062880 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-4e581d2c-0f4c-44e3-a6e2-f73c6c7a0b85 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Calling method '.version_select at 0x7fc2e94a1b70>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:50.094534 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [req-bca0b7ee-298b-4d63-8a37-14cc9a207a38 req-740e7fe5-2d63-4646-94f0-eab4c0dea1a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9231f663-c4c6-4723-8d42-377d3f6dd031", "tag": "8c40a9f8-0504-4483-9e26-48a5210a4191"}]} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:41:50.096953 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:41:50.096953 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:41:50.105820 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-bca0b7ee-298b-4d63-8a37-14cc9a207a38 req-740e7fe5-2d63-4646-94f0-eab4c0dea1a1 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:50.106325 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-bca0b7ee-298b-4d63-8a37-14cc9a207a38 req-740e7fe5-2d63-4646-94f0-eab4c0dea1a1 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:50.123928 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.compute.server_external_events [req-bca0b7ee-298b-4d63-8a37-14cc9a207a38 req-740e7fe5-2d63-4646-94f0-eab4c0dea1a1 service nova] Creating event network-changed:8c40a9f8-0504-4483-9e26-48a5210a4191 for instance 9231f663-c4c6-4723-8d42-377d3f6dd031 on hv-cinder-76019 Feb 17 04:41:50.129709 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [req-bca0b7ee-298b-4d63-8a37-14cc9a207a38 req-740e7fe5-2d63-4646-94f0-eab4c0dea1a1 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.182650 Feb 17 04:41:50.130599 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 341/689] 10.222.0.38 () {64 vars in 1308 bytes} [Wed Feb 17 04:41:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:41:50.136103 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-0a3fd852-daee-4dbc-a4c5-4b245be5b63b tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:50.136877 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-0a3fd852-daee-4dbc-a4c5-4b245be5b63b tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:50.222531 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-0a3fd852-daee-4dbc-a4c5-4b245be5b63b tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:50.231341 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-0a3fd852-daee-4dbc-a4c5-4b245be5b63b tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:50.232908 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-0a3fd852-daee-4dbc-a4c5-4b245be5b63b tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:50.234042 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-0a3fd852-daee-4dbc-a4c5-4b245be5b63b tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d" status: 200 len: 1282 microversion: 2.20 time: 0.102304 Feb 17 04:41:50.234726 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 342/690] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:41:50 2021] GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d => generated 1282 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:41:50.625183 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-4e581d2c-0f4c-44e3-a6e2-f73c6c7a0b85 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] [instance: 9231f663-c4c6-4723-8d42-377d3f6dd031] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:50.635206 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4e581d2c-0f4c-44e3-a6e2-f73c6c7a0b85 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:50.635809 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4e581d2c-0f4c-44e3-a6e2-f73c6c7a0b85 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:50.636881 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4e581d2c-0f4c-44e3-a6e2-f73c6c7a0b85 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:50.637451 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4e581d2c-0f4c-44e3-a6e2-f73c6c7a0b85 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:50.705076 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4e581d2c-0f4c-44e3-a6e2-f73c6c7a0b85 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Acquired lock "refresh_cache-9231f663-c4c6-4723-8d42-377d3f6dd031" {{(pid=98080) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Feb 17 04:41:51.254207 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-c5e6730f-df4f-45a1-bd5b-e2ef2d77442a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:51.254833 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-c5e6730f-df4f-45a1-bd5b-e2ef2d77442a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:51.263740 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c5e6730f-df4f-45a1-bd5b-e2ef2d77442a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:51.264256 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c5e6730f-df4f-45a1-bd5b-e2ef2d77442a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:51.265103 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c5e6730f-df4f-45a1-bd5b-e2ef2d77442a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:51.265599 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c5e6730f-df4f-45a1-bd5b-e2ef2d77442a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:51.759140 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-c5e6730f-df4f-45a1-bd5b-e2ef2d77442a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:51.772245 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-c5e6730f-df4f-45a1-bd5b-e2ef2d77442a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:51.775545 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-c5e6730f-df4f-45a1-bd5b-e2ef2d77442a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:51.776884 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-c5e6730f-df4f-45a1-bd5b-e2ef2d77442a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d" status: 200 len: 1278 microversion: 2.20 time: 0.527436 Feb 17 04:41:51.777987 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 343/691] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:41:51 2021] GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d => generated 1278 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 04:41:52.798818 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-b62911f7-cad1-495d-9a49-35087034a96c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:52.799359 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-b62911f7-cad1-495d-9a49-35087034a96c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:52.807382 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b62911f7-cad1-495d-9a49-35087034a96c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:52.807886 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b62911f7-cad1-495d-9a49-35087034a96c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:52.809023 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b62911f7-cad1-495d-9a49-35087034a96c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:52.809699 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b62911f7-cad1-495d-9a49-35087034a96c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:53.007040 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-b62911f7-cad1-495d-9a49-35087034a96c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:53.018909 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-b62911f7-cad1-495d-9a49-35087034a96c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:53.020483 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-b62911f7-cad1-495d-9a49-35087034a96c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:53.021617 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-b62911f7-cad1-495d-9a49-35087034a96c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d" status: 200 len: 1340 microversion: 2.20 time: 0.228101 Feb 17 04:41:53.022197 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 344/692] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:41:52 2021] GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d => generated 1340 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 04:41:53.153485 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.network.neutron [None req-4e581d2c-0f4c-44e3-a6e2-f73c6c7a0b85 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] [instance: 9231f663-c4c6-4723-8d42-377d3f6dd031] Building network info cache for instance {{(pid=98080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1836}} Feb 17 04:41:53.166457 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [req-82eb2044-d593-458d-a828-4812b70821ff req-5e6e6f4d-60cf-45d0-8f93-3d08909a2aa3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9231f663-c4c6-4723-8d42-377d3f6dd031", "tag": "8c40a9f8-0504-4483-9e26-48a5210a4191"}]} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:41:53.168381 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:41:53.168381 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:41:53.179128 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-82eb2044-d593-458d-a828-4812b70821ff req-5e6e6f4d-60cf-45d0-8f93-3d08909a2aa3 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:53.179641 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-82eb2044-d593-458d-a828-4812b70821ff req-5e6e6f4d-60cf-45d0-8f93-3d08909a2aa3 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:53.200348 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.compute.server_external_events [req-82eb2044-d593-458d-a828-4812b70821ff req-5e6e6f4d-60cf-45d0-8f93-3d08909a2aa3 service nova] Creating event network-changed:8c40a9f8-0504-4483-9e26-48a5210a4191 for instance 9231f663-c4c6-4723-8d42-377d3f6dd031 on hv-cinder-76019 Feb 17 04:41:53.206472 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [req-82eb2044-d593-458d-a828-4812b70821ff req-5e6e6f4d-60cf-45d0-8f93-3d08909a2aa3 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045339 Feb 17 04:41:53.207568 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 345/693] 10.222.0.38 () {64 vars in 1308 bytes} [Wed Feb 17 04:41:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:41:53.932749 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.network.neutron [None req-4e581d2c-0f4c-44e3-a6e2-f73c6c7a0b85 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] [instance: 9231f663-c4c6-4723-8d42-377d3f6dd031] Updating instance_info_cache with network_info: [{"id": "8c40a9f8-0504-4483-9e26-48a5210a4191", "address": "fa:16:3e:ad:b8:06", "network": {"id": "6867f3e4-ec3d-45b2-9435-bb5e12342eb7", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-218432083-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "e57600d4d269474ab7d2f3e7ebf528ac", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tap8c40a9f8-05", "ovs_interfaceid": "8c40a9f8-0504-4483-9e26-48a5210a4191", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=98080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Feb 17 04:41:53.945271 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4e581d2c-0f4c-44e3-a6e2-f73c6c7a0b85 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Releasing lock "refresh_cache-9231f663-c4c6-4723-8d42-377d3f6dd031" {{(pid=98080) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Feb 17 04:41:53.946201 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-4e581d2c-0f4c-44e3-a6e2-f73c6c7a0b85 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] 10.222.0.38 "DELETE /compute/v2.1/os-floating-ips/f9184820-4385-4a5e-a13c-e670190a01e8" status: 202 len: 0 microversion: 2.1 time: 3.888299 Feb 17 04:41:53.947035 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 349/694] 10.222.0.38 () {58 vars in 1253 bytes} [Wed Feb 17 04:41:50 2021] DELETE /compute/v2.1/os-floating-ips/f9184820-4385-4a5e-a13c-e670190a01e8 => generated 0 bytes in 3890 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:41:53.964356 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-4655949a-7aef-406e-a98d-34dc12c60362 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:53.965011 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-4655949a-7aef-406e-a98d-34dc12c60362 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] [instance: 9231f663-c4c6-4723-8d42-377d3f6dd031] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:53.988327 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4655949a-7aef-406e-a98d-34dc12c60362 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:53.988977 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4655949a-7aef-406e-a98d-34dc12c60362 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:53.989852 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4655949a-7aef-406e-a98d-34dc12c60362 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:53.990352 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4655949a-7aef-406e-a98d-34dc12c60362 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:54.042062 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-20401f1a-aa3e-4b64-8f51-2a8055789d8e tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:54.043025 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-20401f1a-aa3e-4b64-8f51-2a8055789d8e tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:54.052791 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-20401f1a-aa3e-4b64-8f51-2a8055789d8e tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:54.053306 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-20401f1a-aa3e-4b64-8f51-2a8055789d8e tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:54.054152 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-20401f1a-aa3e-4b64-8f51-2a8055789d8e tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:54.054857 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-20401f1a-aa3e-4b64-8f51-2a8055789d8e tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:54.189866 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.objects.instance [None req-4655949a-7aef-406e-a98d-34dc12c60362 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lazy-loading 'services' on Instance uuid 9231f663-c4c6-4723-8d42-377d3f6dd031 {{(pid=98081) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:41:54.192507 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-20401f1a-aa3e-4b64-8f51-2a8055789d8e tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:54.202052 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-20401f1a-aa3e-4b64-8f51-2a8055789d8e tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:54.203643 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-20401f1a-aa3e-4b64-8f51-2a8055789d8e tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:54.205341 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-20401f1a-aa3e-4b64-8f51-2a8055789d8e tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d" status: 200 len: 1340 microversion: 2.20 time: 0.167853 Feb 17 04:41:54.205924 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 350/695] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:41:54 2021] GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d => generated 1340 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:41:54.339801 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-4655949a-7aef-406e-a98d-34dc12c60362 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] 10.222.0.38 "DELETE /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031/os-volume_attachments/ee70abce-9c43-4e9b-9de1-472ce008042d" status: 202 len: 0 microversion: 2.1 time: 0.385172 Feb 17 04:41:54.340446 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 346/696] 10.222.0.38 () {58 vars in 1406 bytes} [Wed Feb 17 04:41:53 2021] DELETE /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031/os-volume_attachments/ee70abce-9c43-4e9b-9de1-472ce008042d => generated 0 bytes in 387 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:41:54.350460 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-51c0b923-bf8e-4dab-a85f-92df25b08bc1 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:54.351653 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-51c0b923-bf8e-4dab-a85f-92df25b08bc1 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] [instance: 9231f663-c4c6-4723-8d42-377d3f6dd031] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:54.359647 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-51c0b923-bf8e-4dab-a85f-92df25b08bc1 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:54.360246 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-51c0b923-bf8e-4dab-a85f-92df25b08bc1 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:54.361669 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-51c0b923-bf8e-4dab-a85f-92df25b08bc1 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:54.362173 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-51c0b923-bf8e-4dab-a85f-92df25b08bc1 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:54.433996 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-51c0b923-bf8e-4dab-a85f-92df25b08bc1 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] 10.222.0.38 "GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087705 Feb 17 04:41:54.434612 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 351/697] 10.222.0.38 () {58 vars in 1292 bytes} [Wed Feb 17 04:41:54 2021] GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:41:55.226492 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-a4b47c08-7f71-427b-b16d-1069994d7238 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:55.227333 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-a4b47c08-7f71-427b-b16d-1069994d7238 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:55.236122 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a4b47c08-7f71-427b-b16d-1069994d7238 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:55.236625 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a4b47c08-7f71-427b-b16d-1069994d7238 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:55.237475 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a4b47c08-7f71-427b-b16d-1069994d7238 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:55.237971 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a4b47c08-7f71-427b-b16d-1069994d7238 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:55.439499 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-a4b47c08-7f71-427b-b16d-1069994d7238 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:55.447637 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-60c27083-5c76-440c-8714-a90b292abd98 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:55.448766 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-60c27083-5c76-440c-8714-a90b292abd98 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] [instance: 9231f663-c4c6-4723-8d42-377d3f6dd031] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:55.449733 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-a4b47c08-7f71-427b-b16d-1069994d7238 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:55.451360 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-a4b47c08-7f71-427b-b16d-1069994d7238 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:55.452467 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-a4b47c08-7f71-427b-b16d-1069994d7238 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d" status: 200 len: 1340 microversion: 2.20 time: 0.230759 Feb 17 04:41:55.453584 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 347/698] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:41:55 2021] GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d => generated 1340 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:41:55.458822 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-60c27083-5c76-440c-8714-a90b292abd98 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:55.459340 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-60c27083-5c76-440c-8714-a90b292abd98 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:55.460194 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-60c27083-5c76-440c-8714-a90b292abd98 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:55.460693 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-60c27083-5c76-440c-8714-a90b292abd98 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:55.537995 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-60c27083-5c76-440c-8714-a90b292abd98 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] 10.222.0.38 "GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094314 Feb 17 04:41:55.538628 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 352/699] 10.222.0.38 () {58 vars in 1292 bytes} [Wed Feb 17 04:41:55 2021] GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:41:56.472720 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-0518a45a-6b7f-4e67-94d0-dbc7850c6fb9 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:56.474011 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-0518a45a-6b7f-4e67-94d0-dbc7850c6fb9 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:56.483091 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0518a45a-6b7f-4e67-94d0-dbc7850c6fb9 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:56.483892 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0518a45a-6b7f-4e67-94d0-dbc7850c6fb9 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:56.485813 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0518a45a-6b7f-4e67-94d0-dbc7850c6fb9 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:56.487019 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0518a45a-6b7f-4e67-94d0-dbc7850c6fb9 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:56.550705 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-36a86ec5-47a6-4c65-9c3c-5c0edc82e72c tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:56.551756 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-36a86ec5-47a6-4c65-9c3c-5c0edc82e72c tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] [instance: 9231f663-c4c6-4723-8d42-377d3f6dd031] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:56.565403 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-36a86ec5-47a6-4c65-9c3c-5c0edc82e72c tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:56.565920 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-36a86ec5-47a6-4c65-9c3c-5c0edc82e72c tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:56.566802 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-36a86ec5-47a6-4c65-9c3c-5c0edc82e72c tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:56.567993 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-36a86ec5-47a6-4c65-9c3c-5c0edc82e72c tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:56.641232 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-36a86ec5-47a6-4c65-9c3c-5c0edc82e72c tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] 10.222.0.38 "GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.095307 Feb 17 04:41:56.642059 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 353/700] 10.222.0.38 () {58 vars in 1292 bytes} [Wed Feb 17 04:41:56 2021] GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031/os-volume_attachments => generated 25 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:41:56.652185 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-9f42d1fa-74de-43a4-a213-6d7b2c4e2e3a tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:56.652880 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-9f42d1fa-74de-43a4-a213-6d7b2c4e2e3a tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] [instance: 9231f663-c4c6-4723-8d42-377d3f6dd031] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:56.661250 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9f42d1fa-74de-43a4-a213-6d7b2c4e2e3a tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:56.661827 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9f42d1fa-74de-43a4-a213-6d7b2c4e2e3a tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:56.662796 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9f42d1fa-74de-43a4-a213-6d7b2c4e2e3a tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:56.663184 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9f42d1fa-74de-43a4-a213-6d7b2c4e2e3a tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:56.670409 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-0518a45a-6b7f-4e67-94d0-dbc7850c6fb9 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:56.681732 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-0518a45a-6b7f-4e67-94d0-dbc7850c6fb9 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:56.683333 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-0518a45a-6b7f-4e67-94d0-dbc7850c6fb9 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:56.684735 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-0518a45a-6b7f-4e67-94d0-dbc7850c6fb9 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d" status: 200 len: 1340 microversion: 2.20 time: 0.216825 Feb 17 04:41:56.685313 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 348/701] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:41:56 2021] GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d => generated 1340 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:41:56.848826 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.wsgi [None req-9f42d1fa-74de-43a4-a213-6d7b2c4e2e3a tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] HTTP exception thrown: Instance 9231f663-c4c6-4723-8d42-377d3f6dd031 is not attached to volume ee70abce-9c43-4e9b-9de1-472ce008042d Feb 17 04:41:56.849674 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-9f42d1fa-74de-43a4-a213-6d7b2c4e2e3a tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Returning 404 to user: Instance 9231f663-c4c6-4723-8d42-377d3f6dd031 is not attached to volume ee70abce-9c43-4e9b-9de1-472ce008042d {{(pid=98080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:41:56.850629 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-9f42d1fa-74de-43a4-a213-6d7b2c4e2e3a tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] 10.222.0.38 "DELETE /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031/os-volume_attachments/ee70abce-9c43-4e9b-9de1-472ce008042d" status: 404 len: 154 microversion: 2.1 time: 0.202457 Feb 17 04:41:56.851275 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 354/702] 10.222.0.38 () {58 vars in 1406 bytes} [Wed Feb 17 04:41:56 2021] DELETE /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031/os-volume_attachments/ee70abce-9c43-4e9b-9de1-472ce008042d => generated 154 bytes in 204 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 17 04:41:57.706030 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-a4234877-abda-47a1-acb4-7d1a01725d99 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:57.707391 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-a4234877-abda-47a1-acb4-7d1a01725d99 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:57.716006 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a4234877-abda-47a1-acb4-7d1a01725d99 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:57.716785 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a4234877-abda-47a1-acb4-7d1a01725d99 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:57.717836 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a4234877-abda-47a1-acb4-7d1a01725d99 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:57.718543 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a4234877-abda-47a1-acb4-7d1a01725d99 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:58.124198 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-7e905c9b-392b-4f05-baf2-1dd9727beebc tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:58.124940 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-7e905c9b-392b-4f05-baf2-1dd9727beebc tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] [instance: 9231f663-c4c6-4723-8d42-377d3f6dd031] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:58.138931 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7e905c9b-392b-4f05-baf2-1dd9727beebc tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:58.139448 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7e905c9b-392b-4f05-baf2-1dd9727beebc tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:58.142894 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7e905c9b-392b-4f05-baf2-1dd9727beebc tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:58.142894 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7e905c9b-392b-4f05-baf2-1dd9727beebc tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:58.210987 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-7e905c9b-392b-4f05-baf2-1dd9727beebc tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] [instance: 9231f663-c4c6-4723-8d42-377d3f6dd031] Going to try to terminate instance {{(pid=98080) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 04:41:58.263942 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-a4234877-abda-47a1-acb4-7d1a01725d99 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:58.279713 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-a4234877-abda-47a1-acb4-7d1a01725d99 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:58.281552 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-a4234877-abda-47a1-acb4-7d1a01725d99 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:58.284304 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-a4234877-abda-47a1-acb4-7d1a01725d99 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d" status: 200 len: 1407 microversion: 2.20 time: 0.583370 Feb 17 04:41:58.285707 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 349/703] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:41:57 2021] GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d => generated 1407 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:41:58.343248 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-7e905c9b-392b-4f05-baf2-1dd9727beebc tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] 10.222.0.38 "DELETE /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031" status: 204 len: 0 microversion: 2.1 time: 0.222653 Feb 17 04:41:58.344005 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 355/704] 10.222.0.38 () {58 vars in 1229 bytes} [Wed Feb 17 04:41:58 2021] DELETE /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 17 04:41:58.353573 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-102b06d2-5305-4077-a97f-bae5556ded9a tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:58.354257 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-102b06d2-5305-4077-a97f-bae5556ded9a tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] [instance: 9231f663-c4c6-4723-8d42-377d3f6dd031] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:58.363105 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-102b06d2-5305-4077-a97f-bae5556ded9a tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:58.363634 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-102b06d2-5305-4077-a97f-bae5556ded9a tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:58.364472 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-102b06d2-5305-4077-a97f-bae5556ded9a tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:58.365213 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-102b06d2-5305-4077-a97f-bae5556ded9a tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:59.101106 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-102b06d2-5305-4077-a97f-bae5556ded9a tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190727a0bed54b52913aa6aa1ff8cea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57600d4d269474ab7d2f3e7ebf528ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:59.111615 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-102b06d2-5305-4077-a97f-bae5556ded9a tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] 10.222.0.38 "GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031" status: 200 len: 1552 microversion: 2.1 time: 0.762164 Feb 17 04:41:59.112841 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 350/705] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:41:58 2021] GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031 => generated 1552 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:41:59.305962 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-8a767e30-2343-45cf-846d-63ec2b3896ab tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:41:59.306875 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-8a767e30-2343-45cf-846d-63ec2b3896ab tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:41:59.315800 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8a767e30-2343-45cf-846d-63ec2b3896ab tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:59.316305 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8a767e30-2343-45cf-846d-63ec2b3896ab tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:59.317143 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8a767e30-2343-45cf-846d-63ec2b3896ab tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:59.317635 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8a767e30-2343-45cf-846d-63ec2b3896ab tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:59.751354 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [req-85379b7a-c1d9-496b-8b07-7f4e509c7281 req-35384bd7-6ecd-425f-b054-49322f69a3c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65811bec-2a80-4c2b-a424-f2a986a6055d", "tag": "84c73f3d-c8e5-45a0-9371-0d806cb29e7b"}]} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:41:59.753339 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:41:59.753339 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:41:59.764132 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-85379b7a-c1d9-496b-8b07-7f4e509c7281 req-35384bd7-6ecd-425f-b054-49322f69a3c7 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:41:59.764862 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-85379b7a-c1d9-496b-8b07-7f4e509c7281 req-35384bd7-6ecd-425f-b054-49322f69a3c7 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:41:59.785315 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.compute.server_external_events [req-85379b7a-c1d9-496b-8b07-7f4e509c7281 req-35384bd7-6ecd-425f-b054-49322f69a3c7 service nova] Creating event network-changed:84c73f3d-c8e5-45a0-9371-0d806cb29e7b for instance 65811bec-2a80-4c2b-a424-f2a986a6055d on hv-cinder-76019 Feb 17 04:41:59.790649 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [req-85379b7a-c1d9-496b-8b07-7f4e509c7281 req-35384bd7-6ecd-425f-b054-49322f69a3c7 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043537 Feb 17 04:41:59.791408 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 351/706] 10.222.0.38 () {64 vars in 1308 bytes} [Wed Feb 17 04:41:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:41:59.805091 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-8a767e30-2343-45cf-846d-63ec2b3896ab tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:59.816728 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-8a767e30-2343-45cf-846d-63ec2b3896ab tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:59.818616 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-8a767e30-2343-45cf-846d-63ec2b3896ab tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:41:59.819837 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-8a767e30-2343-45cf-846d-63ec2b3896ab tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d" status: 200 len: 1407 microversion: 2.20 time: 0.519023 Feb 17 04:41:59.820428 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 356/707] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:41:59 2021] GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d => generated 1407 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:42:00.131315 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-741c4589-ff06-4579-b758-ed2dde22f62f tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:00.132084 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-741c4589-ff06-4579-b758-ed2dde22f62f tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] [instance: 9231f663-c4c6-4723-8d42-377d3f6dd031] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:00.140215 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-741c4589-ff06-4579-b758-ed2dde22f62f tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:00.140720 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-741c4589-ff06-4579-b758-ed2dde22f62f tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:00.141610 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-741c4589-ff06-4579-b758-ed2dde22f62f tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:00.142239 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-741c4589-ff06-4579-b758-ed2dde22f62f tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:00.369387 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-741c4589-ff06-4579-b758-ed2dde22f62f tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190727a0bed54b52913aa6aa1ff8cea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57600d4d269474ab7d2f3e7ebf528ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:00.379079 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-741c4589-ff06-4579-b758-ed2dde22f62f tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] 10.222.0.38 "GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031" status: 200 len: 1552 microversion: 2.1 time: 0.252190 Feb 17 04:42:00.379680 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 352/708] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:42:00 2021] GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031 => generated 1552 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:42:00.839081 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-5477a046-4a82-4bc3-abc2-a7a55e35e692 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:00.839744 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-5477a046-4a82-4bc3-abc2-a7a55e35e692 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:00.849072 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5477a046-4a82-4bc3-abc2-a7a55e35e692 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:00.849577 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5477a046-4a82-4bc3-abc2-a7a55e35e692 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:00.850462 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5477a046-4a82-4bc3-abc2-a7a55e35e692 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:00.850934 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5477a046-4a82-4bc3-abc2-a7a55e35e692 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:01.069126 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-5477a046-4a82-4bc3-abc2-a7a55e35e692 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:01.079074 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-5477a046-4a82-4bc3-abc2-a7a55e35e692 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:01.080735 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-5477a046-4a82-4bc3-abc2-a7a55e35e692 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:01.081885 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-5477a046-4a82-4bc3-abc2-a7a55e35e692 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d" status: 200 len: 1407 microversion: 2.20 time: 0.246795 Feb 17 04:42:01.082624 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 357/709] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:42:00 2021] GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d => generated 1407 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:42:01.397175 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-93be8cb3-970a-4fb8-9ba4-2dcd00689c1e tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:01.397878 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-93be8cb3-970a-4fb8-9ba4-2dcd00689c1e tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] [instance: 9231f663-c4c6-4723-8d42-377d3f6dd031] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:01.405633 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-93be8cb3-970a-4fb8-9ba4-2dcd00689c1e tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:01.406134 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-93be8cb3-970a-4fb8-9ba4-2dcd00689c1e tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:01.407561 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-93be8cb3-970a-4fb8-9ba4-2dcd00689c1e tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:01.408055 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-93be8cb3-970a-4fb8-9ba4-2dcd00689c1e tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:01.633076 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-93be8cb3-970a-4fb8-9ba4-2dcd00689c1e tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190727a0bed54b52913aa6aa1ff8cea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57600d4d269474ab7d2f3e7ebf528ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:01.642877 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-93be8cb3-970a-4fb8-9ba4-2dcd00689c1e tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] 10.222.0.38 "GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031" status: 200 len: 1552 microversion: 2.1 time: 0.249668 Feb 17 04:42:01.643478 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 353/710] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:42:01 2021] GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031 => generated 1552 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:42:02.101339 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-94d45022-00ea-4782-9d21-69a535509f9e tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:02.102275 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-94d45022-00ea-4782-9d21-69a535509f9e tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:02.110709 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-94d45022-00ea-4782-9d21-69a535509f9e tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:02.111107 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-94d45022-00ea-4782-9d21-69a535509f9e tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:02.111969 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-94d45022-00ea-4782-9d21-69a535509f9e tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:02.112470 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-94d45022-00ea-4782-9d21-69a535509f9e tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:02.610962 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-94d45022-00ea-4782-9d21-69a535509f9e tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:02.621168 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-94d45022-00ea-4782-9d21-69a535509f9e tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:02.623598 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-94d45022-00ea-4782-9d21-69a535509f9e tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:02.624908 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-94d45022-00ea-4782-9d21-69a535509f9e tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d" status: 200 len: 1407 microversion: 2.20 time: 0.527553 Feb 17 04:42:02.626263 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 358/711] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:42:02 2021] GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d => generated 1407 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:42:02.662143 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-0a5318d5-1bcb-4895-b19a-83a82ebb918c tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:02.662849 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-0a5318d5-1bcb-4895-b19a-83a82ebb918c tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] [instance: 9231f663-c4c6-4723-8d42-377d3f6dd031] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:02.673409 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0a5318d5-1bcb-4895-b19a-83a82ebb918c tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:02.673919 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0a5318d5-1bcb-4895-b19a-83a82ebb918c tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:02.674944 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0a5318d5-1bcb-4895-b19a-83a82ebb918c tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:02.675496 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0a5318d5-1bcb-4895-b19a-83a82ebb918c tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:03.486234 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [req-f23c0d2b-a79a-4ae6-a07f-6365a2a8f26a req-82f9f9cd-f0a1-4777-88c3-113c66f40d0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9231f663-c4c6-4723-8d42-377d3f6dd031", "name": "network-vif-unplugged", "status": "completed", "tag": "8c40a9f8-0504-4483-9e26-48a5210a4191"}]} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:42:03.489087 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:42:03.489087 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:42:03.498532 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-f23c0d2b-a79a-4ae6-a07f-6365a2a8f26a req-82f9f9cd-f0a1-4777-88c3-113c66f40d0a service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:03.499264 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-f23c0d2b-a79a-4ae6-a07f-6365a2a8f26a req-82f9f9cd-f0a1-4777-88c3-113c66f40d0a service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:03.518858 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.compute.server_external_events [req-f23c0d2b-a79a-4ae6-a07f-6365a2a8f26a req-82f9f9cd-f0a1-4777-88c3-113c66f40d0a service nova] Creating event network-vif-unplugged:8c40a9f8-0504-4483-9e26-48a5210a4191 for instance 9231f663-c4c6-4723-8d42-377d3f6dd031 on hv-cinder-76019 Feb 17 04:42:03.528691 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [req-f23c0d2b-a79a-4ae6-a07f-6365a2a8f26a req-82f9f9cd-f0a1-4777-88c3-113c66f40d0a service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.200924 Feb 17 04:42:03.529725 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 359/712] 10.222.0.38 () {64 vars in 1308 bytes} [Wed Feb 17 04:42:03 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:42:03.646748 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-11306284-3ba7-497d-95d3-12118a3a1457 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:03.648123 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-11306284-3ba7-497d-95d3-12118a3a1457 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:03.659572 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-11306284-3ba7-497d-95d3-12118a3a1457 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:03.660264 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-11306284-3ba7-497d-95d3-12118a3a1457 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:03.661464 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-11306284-3ba7-497d-95d3-12118a3a1457 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:03.662122 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-11306284-3ba7-497d-95d3-12118a3a1457 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:03.760552 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-0a5318d5-1bcb-4895-b19a-83a82ebb918c tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190727a0bed54b52913aa6aa1ff8cea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57600d4d269474ab7d2f3e7ebf528ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:03.772714 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-0a5318d5-1bcb-4895-b19a-83a82ebb918c tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] 10.222.0.38 "GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031" status: 200 len: 1552 microversion: 2.1 time: 1.115172 Feb 17 04:42:03.773723 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 354/713] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:42:02 2021] GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031 => generated 1552 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:42:04.191824 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-11306284-3ba7-497d-95d3-12118a3a1457 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:04.202131 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-11306284-3ba7-497d-95d3-12118a3a1457 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:04.204003 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-11306284-3ba7-497d-95d3-12118a3a1457 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:04.205380 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-11306284-3ba7-497d-95d3-12118a3a1457 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d" status: 200 len: 1407 microversion: 2.20 time: 0.563056 Feb 17 04:42:04.206056 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 360/714] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:42:03 2021] GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d => generated 1407 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 04:42:04.791994 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-33dd8aac-55a3-4d70-9ee0-db13494371f0 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:04.792683 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-33dd8aac-55a3-4d70-9ee0-db13494371f0 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] [instance: 9231f663-c4c6-4723-8d42-377d3f6dd031] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:04.801315 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-33dd8aac-55a3-4d70-9ee0-db13494371f0 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:04.801835 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-33dd8aac-55a3-4d70-9ee0-db13494371f0 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:04.802744 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-33dd8aac-55a3-4d70-9ee0-db13494371f0 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:04.803251 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-33dd8aac-55a3-4d70-9ee0-db13494371f0 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:05.226762 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-ff5533a6-99e6-4bed-b164-5fe50324221f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:05.227627 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-ff5533a6-99e6-4bed-b164-5fe50324221f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:05.236751 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ff5533a6-99e6-4bed-b164-5fe50324221f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:05.237486 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ff5533a6-99e6-4bed-b164-5fe50324221f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:05.238486 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ff5533a6-99e6-4bed-b164-5fe50324221f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:05.239157 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ff5533a6-99e6-4bed-b164-5fe50324221f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:05.279507 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-33dd8aac-55a3-4d70-9ee0-db13494371f0 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '190727a0bed54b52913aa6aa1ff8cea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57600d4d269474ab7d2f3e7ebf528ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:05.298666 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-33dd8aac-55a3-4d70-9ee0-db13494371f0 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] 10.222.0.38 "GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031" status: 200 len: 1552 microversion: 2.1 time: 0.510736 Feb 17 04:42:05.310948 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 355/715] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:42:04 2021] GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031 => generated 1552 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:42:05.483881 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [req-04451b34-9d16-40cc-a76a-35dc2e4e69f5 req-57a0aa43-45a0-415f-a6d4-f66cab87e767 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9231f663-c4c6-4723-8d42-377d3f6dd031", "name": "network-vif-deleted", "tag": "8c40a9f8-0504-4483-9e26-48a5210a4191"}]} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:42:05.485829 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:42:05.485829 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:42:05.495081 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-04451b34-9d16-40cc-a76a-35dc2e4e69f5 req-57a0aa43-45a0-415f-a6d4-f66cab87e767 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:05.495569 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-04451b34-9d16-40cc-a76a-35dc2e4e69f5 req-57a0aa43-45a0-415f-a6d4-f66cab87e767 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:05.518477 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.compute.server_external_events [req-04451b34-9d16-40cc-a76a-35dc2e4e69f5 req-57a0aa43-45a0-415f-a6d4-f66cab87e767 service nova] Creating event network-vif-deleted:8c40a9f8-0504-4483-9e26-48a5210a4191 for instance 9231f663-c4c6-4723-8d42-377d3f6dd031 on hv-cinder-76019 Feb 17 04:42:05.526087 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [req-04451b34-9d16-40cc-a76a-35dc2e4e69f5 req-57a0aa43-45a0-415f-a6d4-f66cab87e767 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045339 Feb 17 04:42:05.527249 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 356/716] 10.222.0.38 () {64 vars in 1308 bytes} [Wed Feb 17 04:42:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:42:05.565446 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-ff5533a6-99e6-4bed-b164-5fe50324221f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:05.576086 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-ff5533a6-99e6-4bed-b164-5fe50324221f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:05.578228 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-ff5533a6-99e6-4bed-b164-5fe50324221f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:05.580223 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-ff5533a6-99e6-4bed-b164-5fe50324221f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d" status: 200 len: 1407 microversion: 2.20 time: 0.358814 Feb 17 04:42:05.581204 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 361/717] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:42:05 2021] GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d => generated 1407 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:42:06.319220 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-54069d01-7bcd-4181-bf7c-7cf1604352f0 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:06.320002 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-54069d01-7bcd-4181-bf7c-7cf1604352f0 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] [instance: 9231f663-c4c6-4723-8d42-377d3f6dd031] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:06.329093 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-54069d01-7bcd-4181-bf7c-7cf1604352f0 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:06.329604 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-54069d01-7bcd-4181-bf7c-7cf1604352f0 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:06.330443 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-54069d01-7bcd-4181-bf7c-7cf1604352f0 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:06.331129 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-54069d01-7bcd-4181-bf7c-7cf1604352f0 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:06.386425 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.wsgi [None req-54069d01-7bcd-4181-bf7c-7cf1604352f0 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] HTTP exception thrown: Instance 9231f663-c4c6-4723-8d42-377d3f6dd031 could not be found. Feb 17 04:42:06.387166 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-54069d01-7bcd-4181-bf7c-7cf1604352f0 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Returning 404 to user: Instance 9231f663-c4c6-4723-8d42-377d3f6dd031 could not be found. {{(pid=98081) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:42:06.388094 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-54069d01-7bcd-4181-bf7c-7cf1604352f0 tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] 10.222.0.38 "GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031" status: 404 len: 111 microversion: 2.1 time: 0.074407 Feb 17 04:42:06.388897 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 357/718] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:42:06 2021] GET /compute/v2.1/servers/9231f663-c4c6-4723-8d42-377d3f6dd031 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:42:06.397472 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-be226a90-4347-471e-a2c8-48e850a166da tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] Calling method '.version_select at 0x7fc2e9385d08>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:06.415246 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-be226a90-4347-471e-a2c8-48e850a166da tempest-TestMinimumBasicScenario-76766256 tempest-TestMinimumBasicScenario-76766256-project] 10.222.0.38 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-693993925" status: 202 len: 0 microversion: 2.1 time: 0.021724 Feb 17 04:42:06.415894 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 362/719] 10.222.0.38 () {58 vars in 1259 bytes} [Wed Feb 17 04:42:06 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-693993925 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:42:06.604566 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-3639c6c7-3124-474b-8bc5-f339ce708cc4 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:06.605856 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-3639c6c7-3124-474b-8bc5-f339ce708cc4 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:06.625060 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-3639c6c7-3124-474b-8bc5-f339ce708cc4 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:06.626757 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-3639c6c7-3124-474b-8bc5-f339ce708cc4 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:06.629012 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-3639c6c7-3124-474b-8bc5-f339ce708cc4 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:06.631567 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-3639c6c7-3124-474b-8bc5-f339ce708cc4 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:06.910767 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-3639c6c7-3124-474b-8bc5-f339ce708cc4 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:06.921128 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-3639c6c7-3124-474b-8bc5-f339ce708cc4 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:06.923363 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-3639c6c7-3124-474b-8bc5-f339ce708cc4 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:06.927900 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-3639c6c7-3124-474b-8bc5-f339ce708cc4 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d" status: 200 len: 1407 microversion: 2.20 time: 0.326978 Feb 17 04:42:06.928772 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 358/720] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:42:06 2021] GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d => generated 1407 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:42:07.741089 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [req-98a577f9-a326-4a62-93c3-a7f8c39d4508 req-e42ace04-ef1d-4e87-abab-4c334d489bbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65811bec-2a80-4c2b-a424-f2a986a6055d", "name": "network-vif-plugged", "status": "completed", "tag": "84c73f3d-c8e5-45a0-9371-0d806cb29e7b"}]} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:42:07.743089 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:42:07.743089 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:42:07.753816 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-98a577f9-a326-4a62-93c3-a7f8c39d4508 req-e42ace04-ef1d-4e87-abab-4c334d489bbd service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:07.754520 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-98a577f9-a326-4a62-93c3-a7f8c39d4508 req-e42ace04-ef1d-4e87-abab-4c334d489bbd service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:07.777612 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.compute.server_external_events [req-98a577f9-a326-4a62-93c3-a7f8c39d4508 req-e42ace04-ef1d-4e87-abab-4c334d489bbd service nova] Creating event network-vif-plugged:84c73f3d-c8e5-45a0-9371-0d806cb29e7b for instance 65811bec-2a80-4c2b-a424-f2a986a6055d on hv-cinder-76019 Feb 17 04:42:07.783966 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [req-98a577f9-a326-4a62-93c3-a7f8c39d4508 req-e42ace04-ef1d-4e87-abab-4c334d489bbd service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049193 Feb 17 04:42:07.785136 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 363/721] 10.222.0.38 () {64 vars in 1308 bytes} [Wed Feb 17 04:42:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:42:07.959763 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-a627be2c-774b-4a35-8f91-73cea44d812c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:07.961023 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-a627be2c-774b-4a35-8f91-73cea44d812c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:07.983736 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a627be2c-774b-4a35-8f91-73cea44d812c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:07.985793 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a627be2c-774b-4a35-8f91-73cea44d812c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:07.987072 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a627be2c-774b-4a35-8f91-73cea44d812c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:07.987790 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a627be2c-774b-4a35-8f91-73cea44d812c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:08.289415 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-a627be2c-774b-4a35-8f91-73cea44d812c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:08.300036 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-a627be2c-774b-4a35-8f91-73cea44d812c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:08.301610 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-a627be2c-774b-4a35-8f91-73cea44d812c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:08.302924 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-a627be2c-774b-4a35-8f91-73cea44d812c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d" status: 200 len: 1407 microversion: 2.20 time: 0.348212 Feb 17 04:42:08.303506 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 359/722] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:42:07 2021] GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d => generated 1407 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:42:09.324561 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-415d166e-0f1a-4687-af57-3367fb082f86 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:09.325857 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-415d166e-0f1a-4687-af57-3367fb082f86 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:09.354511 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-415d166e-0f1a-4687-af57-3367fb082f86 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:09.354966 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-415d166e-0f1a-4687-af57-3367fb082f86 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:09.355857 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-415d166e-0f1a-4687-af57-3367fb082f86 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:09.356358 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-415d166e-0f1a-4687-af57-3367fb082f86 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:10.156629 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-415d166e-0f1a-4687-af57-3367fb082f86 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:10.175647 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-415d166e-0f1a-4687-af57-3367fb082f86 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:10.177965 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-415d166e-0f1a-4687-af57-3367fb082f86 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:10.179780 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-415d166e-0f1a-4687-af57-3367fb082f86 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d" status: 200 len: 1599 microversion: 2.20 time: 0.859678 Feb 17 04:42:10.181131 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 364/723] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:42:09 2021] GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d => generated 1599 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:42:10.199484 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-1df52c2d-adc6-4442-a22e-eaa3893f15ce tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:10.200046 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-1df52c2d-adc6-4442-a22e-eaa3893f15ce tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:10.208929 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1df52c2d-adc6-4442-a22e-eaa3893f15ce tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:10.209421 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1df52c2d-adc6-4442-a22e-eaa3893f15ce tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:10.210482 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1df52c2d-adc6-4442-a22e-eaa3893f15ce tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:10.211487 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1df52c2d-adc6-4442-a22e-eaa3893f15ce tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:10.493885 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-1df52c2d-adc6-4442-a22e-eaa3893f15ce tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.298347 Feb 17 04:42:10.494549 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 360/724] 10.222.0.38 () {60 vars in 1306 bytes} [Wed Feb 17 04:42:10 2021] GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d/os-interface => generated 284 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:42:12.297560 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [req-789181bb-fb21-42df-a650-ff4f456ed8f7 req-dcec7b6c-a811-40ed-9bb8-486b04567d59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65811bec-2a80-4c2b-a424-f2a986a6055d", "tag": "84c73f3d-c8e5-45a0-9371-0d806cb29e7b"}]} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:42:12.299426 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:42:12.299426 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:42:12.302638 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-111cfc76-28ca-4974-8e86-c5e9b6a8dc2c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:42:12.303716 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-111cfc76-28ca-4974-8e86-c5e9b6a8dc2c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:12.329172 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-111cfc76-28ca-4974-8e86-c5e9b6a8dc2c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:12.345402 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-111cfc76-28ca-4974-8e86-c5e9b6a8dc2c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:12.346336 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-111cfc76-28ca-4974-8e86-c5e9b6a8dc2c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:12.353692 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-111cfc76-28ca-4974-8e86-c5e9b6a8dc2c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:12.362712 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-789181bb-fb21-42df-a650-ff4f456ed8f7 req-dcec7b6c-a811-40ed-9bb8-486b04567d59 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:12.363333 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-789181bb-fb21-42df-a650-ff4f456ed8f7 req-dcec7b6c-a811-40ed-9bb8-486b04567d59 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:12.414679 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.compute.server_external_events [req-789181bb-fb21-42df-a650-ff4f456ed8f7 req-dcec7b6c-a811-40ed-9bb8-486b04567d59 service nova] Creating event network-changed:84c73f3d-c8e5-45a0-9371-0d806cb29e7b for instance 65811bec-2a80-4c2b-a424-f2a986a6055d on hv-cinder-76019 Feb 17 04:42:12.440923 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [req-789181bb-fb21-42df-a650-ff4f456ed8f7 req-dcec7b6c-a811-40ed-9bb8-486b04567d59 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.147571 Feb 17 04:42:12.441605 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 361/725] 10.222.0.38 () {64 vars in 1308 bytes} [Wed Feb 17 04:42:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:42:12.565911 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-111cfc76-28ca-4974-8e86-c5e9b6a8dc2c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "POST /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d/action" status: 200 len: 14 microversion: 2.20 time: 0.276568 Feb 17 04:42:12.569845 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 365/726] 10.222.0.38 () {62 vars in 1309 bytes} [Wed Feb 17 04:42:12 2021] POST /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d/action => generated 14 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:42:13.579308 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-b12fb2ac-83a7-44a1-9d0d-2d9f5fc4f8ac tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:42:13.582208 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-b12fb2ac-83a7-44a1-9d0d-2d9f5fc4f8ac tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:13.598313 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b12fb2ac-83a7-44a1-9d0d-2d9f5fc4f8ac tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:13.601811 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b12fb2ac-83a7-44a1-9d0d-2d9f5fc4f8ac tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:13.605782 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b12fb2ac-83a7-44a1-9d0d-2d9f5fc4f8ac tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:13.606753 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b12fb2ac-83a7-44a1-9d0d-2d9f5fc4f8ac tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:13.818226 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-b12fb2ac-83a7-44a1-9d0d-2d9f5fc4f8ac tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "POST /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d/action" status: 200 len: 14 microversion: 2.20 time: 0.243653 Feb 17 04:42:13.819261 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 362/727] 10.222.0.38 () {62 vars in 1309 bytes} [Wed Feb 17 04:42:13 2021] POST /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d/action => generated 14 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:42:14.833659 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-16a70077-8ca0-4513-b34f-70fc52489b84 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:42:14.836927 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-16a70077-8ca0-4513-b34f-70fc52489b84 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:14.847430 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-16a70077-8ca0-4513-b34f-70fc52489b84 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:14.848219 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-16a70077-8ca0-4513-b34f-70fc52489b84 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:14.849253 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-16a70077-8ca0-4513-b34f-70fc52489b84 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:14.850064 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-16a70077-8ca0-4513-b34f-70fc52489b84 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:14.972138 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-16a70077-8ca0-4513-b34f-70fc52489b84 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "POST /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d/action" status: 200 len: 14 microversion: 2.20 time: 0.143270 Feb 17 04:42:14.973350 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 366/728] 10.222.0.38 () {62 vars in 1309 bytes} [Wed Feb 17 04:42:14 2021] POST /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d/action => generated 14 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:42:15.986190 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-3d99fa56-3977-4c31-8ca6-f43853afe914 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:42:15.987495 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-3d99fa56-3977-4c31-8ca6-f43853afe914 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:16.005464 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-3d99fa56-3977-4c31-8ca6-f43853afe914 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:16.006263 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-3d99fa56-3977-4c31-8ca6-f43853afe914 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:16.008990 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-3d99fa56-3977-4c31-8ca6-f43853afe914 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:16.010182 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-3d99fa56-3977-4c31-8ca6-f43853afe914 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:16.111427 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-3d99fa56-3977-4c31-8ca6-f43853afe914 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "POST /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d/action" status: 200 len: 14 microversion: 2.20 time: 0.130113 Feb 17 04:42:16.112271 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 363/729] 10.222.0.38 () {62 vars in 1309 bytes} [Wed Feb 17 04:42:15 2021] POST /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d/action => generated 14 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:42:17.124634 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-51c15229-65b5-4798-b116-ca92c52fe633 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:42:17.126629 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-51c15229-65b5-4798-b116-ca92c52fe633 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:17.146492 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-51c15229-65b5-4798-b116-ca92c52fe633 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:17.147366 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-51c15229-65b5-4798-b116-ca92c52fe633 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:17.148533 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-51c15229-65b5-4798-b116-ca92c52fe633 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:17.149527 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-51c15229-65b5-4798-b116-ca92c52fe633 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:17.344702 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-51c15229-65b5-4798-b116-ca92c52fe633 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "POST /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d/action" status: 200 len: 14 microversion: 2.20 time: 0.224209 Feb 17 04:42:17.348329 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 367/730] 10.222.0.38 () {62 vars in 1309 bytes} [Wed Feb 17 04:42:17 2021] POST /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d/action => generated 14 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:42:18.356703 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-22d6b380-b8a1-48d2-9309-9b9903fd0f2d tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:42:18.357846 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-22d6b380-b8a1-48d2-9309-9b9903fd0f2d tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:18.369427 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-22d6b380-b8a1-48d2-9309-9b9903fd0f2d tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:18.370229 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-22d6b380-b8a1-48d2-9309-9b9903fd0f2d tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:18.371883 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-22d6b380-b8a1-48d2-9309-9b9903fd0f2d tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:18.372571 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-22d6b380-b8a1-48d2-9309-9b9903fd0f2d tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:18.475816 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-22d6b380-b8a1-48d2-9309-9b9903fd0f2d tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "POST /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d/action" status: 200 len: 14 microversion: 2.20 time: 0.123309 Feb 17 04:42:18.479232 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 364/731] 10.222.0.38 () {62 vars in 1309 bytes} [Wed Feb 17 04:42:18 2021] POST /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d/action => generated 14 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:42:18.917588 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-f7b4dacd-f7e5-4a6e-b91b-d8fbfd69b13d tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-960980509", "imageRef": "2d6991a7-a1f0-444b-8fd5-d05558b5f9a4", "flavorRef": "452", "networks": [{"uuid": "c6a84f22-8956-4c6c-8e1a-35ad1301db27"}]}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:42:19.026189 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.network.neutron [None req-f7b4dacd-f7e5-4a6e-b91b-d8fbfd69b13d tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] validate_networks() for [('c6a84f22-8956-4c6c-8e1a-35ad1301db27', None, None, None)] {{(pid=98080) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 04:42:19.489890 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-806a7e55-173a-49bb-a2d3-27d1508d3de5 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:42:19.492251 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-806a7e55-173a-49bb-a2d3-27d1508d3de5 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:19.502892 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-806a7e55-173a-49bb-a2d3-27d1508d3de5 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:19.503742 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-806a7e55-173a-49bb-a2d3-27d1508d3de5 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:19.504829 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-806a7e55-173a-49bb-a2d3-27d1508d3de5 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:19.506090 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-806a7e55-173a-49bb-a2d3-27d1508d3de5 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:19.614224 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-f7b4dacd-f7e5-4a6e-b91b-d8fbfd69b13d tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Flavor limits 0:0:0 {{(pid=98080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 04:42:19.614734 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-f7b4dacd-f7e5-4a6e-b91b-d8fbfd69b13d tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Image limits 0:0:0 {{(pid=98080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 04:42:19.615284 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-f7b4dacd-f7e5-4a6e-b91b-d8fbfd69b13d tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Flavor pref 0:0:0 {{(pid=98080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 04:42:19.615750 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-f7b4dacd-f7e5-4a6e-b91b-d8fbfd69b13d tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Image pref 0:0:0 {{(pid=98080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 04:42:19.616219 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-f7b4dacd-f7e5-4a6e-b91b-d8fbfd69b13d tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 04:42:19.623071 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-806a7e55-173a-49bb-a2d3-27d1508d3de5 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "POST /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d/action" status: 200 len: 14 microversion: 2.20 time: 0.139136 Feb 17 04:42:19.623784 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 365/732] 10.222.0.38 () {62 vars in 1309 bytes} [Wed Feb 17 04:42:19 2021] POST /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d/action => generated 14 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:42:19.625258 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f7b4dacd-f7e5-4a6e-b91b-d8fbfd69b13d tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:19.625774 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f7b4dacd-f7e5-4a6e-b91b-d8fbfd69b13d tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:19.627200 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f7b4dacd-f7e5-4a6e-b91b-d8fbfd69b13d tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:19.628091 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f7b4dacd-f7e5-4a6e-b91b-d8fbfd69b13d tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:19.647742 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.quota [None req-f7b4dacd-f7e5-4a6e-b91b-d8fbfd69b13d tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Getting quotas for project 21b5af96686e409cb77e5a0aa9ac1fb8. Resources: {'instances', 'cores', 'ram'} {{(pid=98080) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:42:19.652142 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.quota [None req-f7b4dacd-f7e5-4a6e-b91b-d8fbfd69b13d tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Getting quotas for user e26e476d21764ecfaf94b5f9a9d25b6b and project 21b5af96686e409cb77e5a0aa9ac1fb8. Resources: {'instances', 'cores', 'ram'} {{(pid=98080) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:42:19.665145 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-f7b4dacd-f7e5-4a6e-b91b-d8fbfd69b13d tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Going to run 1 instances... {{(pid=98080) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 04:42:19.668057 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-f7b4dacd-f7e5-4a6e-b91b-d8fbfd69b13d tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] [instance: 3470f07e-b94c-42d4-afdf-917b1ffa6a4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d6991a7-a1f0-444b-8fd5-d05558b5f9a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98080) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 04:42:19.719407 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-f7b4dacd-f7e5-4a6e-b91b-d8fbfd69b13d tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] 10.222.0.38 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.806398 Feb 17 04:42:19.720477 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 368/733] 10.222.0.38 () {60 vars in 1137 bytes} [Wed Feb 17 04:42:18 2021] POST /compute/v2.1/servers => generated 380 bytes in 808 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 17 04:42:19.731487 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-b00899c3-f289-49db-817d-bc9af9963f99 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:19.732264 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-b00899c3-f289-49db-817d-bc9af9963f99 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] [instance: 3470f07e-b94c-42d4-afdf-917b1ffa6a4d] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:19.820075 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-b00899c3-f289-49db-817d-bc9af9963f99 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e476d21764ecfaf94b5f9a9d25b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b5af96686e409cb77e5a0aa9ac1fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:19.829040 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-b00899c3-f289-49db-817d-bc9af9963f99 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] 10.222.0.38 "GET /compute/v2.1/servers/3470f07e-b94c-42d4-afdf-917b1ffa6a4d" status: 200 len: 1213 microversion: 2.1 time: 0.101899 Feb 17 04:42:19.830075 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 366/734] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:42:19 2021] GET /compute/v2.1/servers/3470f07e-b94c-42d4-afdf-917b1ffa6a4d => generated 1213 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:42:20.637874 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-287eea8b-b17c-4b4a-9da6-1186ecbcd803 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:42:20.640793 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-287eea8b-b17c-4b4a-9da6-1186ecbcd803 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:20.652086 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-287eea8b-b17c-4b4a-9da6-1186ecbcd803 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:20.652934 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-287eea8b-b17c-4b4a-9da6-1186ecbcd803 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:20.654185 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-287eea8b-b17c-4b4a-9da6-1186ecbcd803 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:20.654959 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-287eea8b-b17c-4b4a-9da6-1186ecbcd803 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:20.760636 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-287eea8b-b17c-4b4a-9da6-1186ecbcd803 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "POST /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d/action" status: 200 len: 14 microversion: 2.20 time: 0.128635 Feb 17 04:42:20.761846 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 369/735] 10.222.0.38 () {62 vars in 1309 bytes} [Wed Feb 17 04:42:20 2021] POST /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d/action => generated 14 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:42:20.849460 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-83b48826-3af9-4cc1-9354-f9b8a6f8c620 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:20.850506 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-83b48826-3af9-4cc1-9354-f9b8a6f8c620 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] [instance: 3470f07e-b94c-42d4-afdf-917b1ffa6a4d] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:20.860843 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-83b48826-3af9-4cc1-9354-f9b8a6f8c620 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:20.861930 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-83b48826-3af9-4cc1-9354-f9b8a6f8c620 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:20.862921 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-83b48826-3af9-4cc1-9354-f9b8a6f8c620 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:20.863469 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-83b48826-3af9-4cc1-9354-f9b8a6f8c620 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:21.017755 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-83b48826-3af9-4cc1-9354-f9b8a6f8c620 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e476d21764ecfaf94b5f9a9d25b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b5af96686e409cb77e5a0aa9ac1fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:21.038160 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-83b48826-3af9-4cc1-9354-f9b8a6f8c620 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] 10.222.0.38 "GET /compute/v2.1/servers/3470f07e-b94c-42d4-afdf-917b1ffa6a4d" status: 200 len: 1265 microversion: 2.1 time: 0.194687 Feb 17 04:42:21.039712 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 367/736] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:42:20 2021] GET /compute/v2.1/servers/3470f07e-b94c-42d4-afdf-917b1ffa6a4d => generated 1265 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:42:21.774914 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-2ff6914a-0e19-4414-b749-6ea5ccc690cf tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:42:21.776884 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-2ff6914a-0e19-4414-b749-6ea5ccc690cf tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:21.799488 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2ff6914a-0e19-4414-b749-6ea5ccc690cf tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:21.801526 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2ff6914a-0e19-4414-b749-6ea5ccc690cf tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:21.804129 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2ff6914a-0e19-4414-b749-6ea5ccc690cf tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:21.806843 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2ff6914a-0e19-4414-b749-6ea5ccc690cf tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:21.945376 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-2ff6914a-0e19-4414-b749-6ea5ccc690cf tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "POST /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d/action" status: 200 len: 13107 microversion: 2.20 time: 0.176275 Feb 17 04:42:21.946841 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 370/737] 10.222.0.38 () {62 vars in 1309 bytes} [Wed Feb 17 04:42:21 2021] POST /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d/action => generated 13107 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:42:22.057490 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-aa435154-e848-484c-a8b1-f1de7f807f2c tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:22.058973 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-aa435154-e848-484c-a8b1-f1de7f807f2c tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] [instance: 3470f07e-b94c-42d4-afdf-917b1ffa6a4d] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:22.070358 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-aa435154-e848-484c-a8b1-f1de7f807f2c tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:22.071236 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-aa435154-e848-484c-a8b1-f1de7f807f2c tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:22.073066 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-aa435154-e848-484c-a8b1-f1de7f807f2c tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:22.073786 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-aa435154-e848-484c-a8b1-f1de7f807f2c tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:22.355056 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-aa435154-e848-484c-a8b1-f1de7f807f2c tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e476d21764ecfaf94b5f9a9d25b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b5af96686e409cb77e5a0aa9ac1fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:22.371991 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-aa435154-e848-484c-a8b1-f1de7f807f2c tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] 10.222.0.38 "GET /compute/v2.1/servers/3470f07e-b94c-42d4-afdf-917b1ffa6a4d" status: 200 len: 1271 microversion: 2.1 time: 0.318476 Feb 17 04:42:22.376870 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 368/738] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:42:22 2021] GET /compute/v2.1/servers/3470f07e-b94c-42d4-afdf-917b1ffa6a4d => generated 1271 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:42:22.959102 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-095dd510-d406-4dd7-a5d8-0b57c54050f9 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:42:22.960271 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-095dd510-d406-4dd7-a5d8-0b57c54050f9 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:22.999548 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-095dd510-d406-4dd7-a5d8-0b57c54050f9 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:23.000526 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-095dd510-d406-4dd7-a5d8-0b57c54050f9 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:23.001664 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-095dd510-d406-4dd7-a5d8-0b57c54050f9 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:23.002368 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-095dd510-d406-4dd7-a5d8-0b57c54050f9 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:23.154135 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-095dd510-d406-4dd7-a5d8-0b57c54050f9 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "POST /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d/action" status: 200 len: 18561 microversion: 2.20 time: 0.199469 Feb 17 04:42:23.156118 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 371/739] 10.222.0.38 () {62 vars in 1309 bytes} [Wed Feb 17 04:42:22 2021] POST /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d/action => generated 18561 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:42:23.394892 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-a818a7ff-abfe-4c90-aca5-d8d292bb3982 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:23.395840 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-a818a7ff-abfe-4c90-aca5-d8d292bb3982 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] [instance: 3470f07e-b94c-42d4-afdf-917b1ffa6a4d] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:23.417477 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a818a7ff-abfe-4c90-aca5-d8d292bb3982 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:23.418000 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a818a7ff-abfe-4c90-aca5-d8d292bb3982 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:23.418904 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a818a7ff-abfe-4c90-aca5-d8d292bb3982 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:23.419407 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a818a7ff-abfe-4c90-aca5-d8d292bb3982 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:24.169664 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-232a7de6-25e3-4010-a7e0-dd77c56e764e tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:42:24.171527 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-232a7de6-25e3-4010-a7e0-dd77c56e764e tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:24.180729 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-232a7de6-25e3-4010-a7e0-dd77c56e764e tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:24.181426 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-232a7de6-25e3-4010-a7e0-dd77c56e764e tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:24.182460 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-232a7de6-25e3-4010-a7e0-dd77c56e764e tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:24.183362 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-232a7de6-25e3-4010-a7e0-dd77c56e764e tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:24.196089 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-a818a7ff-abfe-4c90-aca5-d8d292bb3982 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e476d21764ecfaf94b5f9a9d25b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b5af96686e409cb77e5a0aa9ac1fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:24.212273 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-a818a7ff-abfe-4c90-aca5-d8d292bb3982 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] 10.222.0.38 "GET /compute/v2.1/servers/3470f07e-b94c-42d4-afdf-917b1ffa6a4d" status: 200 len: 1313 microversion: 2.1 time: 0.822062 Feb 17 04:42:24.212890 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 369/740] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:42:23 2021] GET /compute/v2.1/servers/3470f07e-b94c-42d4-afdf-917b1ffa6a4d => generated 1313 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:42:24.304866 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-232a7de6-25e3-4010-a7e0-dd77c56e764e tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "POST /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d/action" status: 200 len: 19342 microversion: 2.20 time: 0.138896 Feb 17 04:42:24.305618 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 372/741] 10.222.0.38 () {62 vars in 1309 bytes} [Wed Feb 17 04:42:24 2021] POST /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d/action => generated 19342 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:42:25.060162 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [req-53d87ea3-df29-47b0-808d-1e3107298a98 req-3ebb64ef-ba81-40a8-b52b-8ebff8e64ae1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3470f07e-b94c-42d4-afdf-917b1ffa6a4d", "tag": "a4af3de5-d823-4909-ba1c-870f8e598dbe"}]} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:42:25.063385 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:42:25.063385 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:42:25.080343 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-53d87ea3-df29-47b0-808d-1e3107298a98 req-3ebb64ef-ba81-40a8-b52b-8ebff8e64ae1 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:25.080848 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-53d87ea3-df29-47b0-808d-1e3107298a98 req-3ebb64ef-ba81-40a8-b52b-8ebff8e64ae1 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:25.102193 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.compute.server_external_events [req-53d87ea3-df29-47b0-808d-1e3107298a98 req-3ebb64ef-ba81-40a8-b52b-8ebff8e64ae1 service nova] Creating event network-changed:a4af3de5-d823-4909-ba1c-870f8e598dbe for instance 3470f07e-b94c-42d4-afdf-917b1ffa6a4d on hv-cinder-76019 Feb 17 04:42:25.107656 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [req-53d87ea3-df29-47b0-808d-1e3107298a98 req-3ebb64ef-ba81-40a8-b52b-8ebff8e64ae1 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052147 Feb 17 04:42:25.108304 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 370/742] 10.222.0.38 () {64 vars in 1308 bytes} [Wed Feb 17 04:42:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:42:25.232957 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-778be6c2-90a0-4885-803d-bcdbda3512ec tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:25.237855 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-778be6c2-90a0-4885-803d-bcdbda3512ec tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] [instance: 3470f07e-b94c-42d4-afdf-917b1ffa6a4d] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:25.255085 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-778be6c2-90a0-4885-803d-bcdbda3512ec tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:25.255932 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-778be6c2-90a0-4885-803d-bcdbda3512ec tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:25.257001 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-778be6c2-90a0-4885-803d-bcdbda3512ec tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:25.257712 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-778be6c2-90a0-4885-803d-bcdbda3512ec tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:25.320505 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-15cc157f-342d-415b-9f5b-9541c5826ffb tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:42:25.322280 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-15cc157f-342d-415b-9f5b-9541c5826ffb tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:25.333049 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-15cc157f-342d-415b-9f5b-9541c5826ffb tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:25.333932 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-15cc157f-342d-415b-9f5b-9541c5826ffb tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:25.335225 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-15cc157f-342d-415b-9f5b-9541c5826ffb tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:25.335872 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-15cc157f-342d-415b-9f5b-9541c5826ffb tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:25.488178 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-15cc157f-342d-415b-9f5b-9541c5826ffb tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "POST /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d/action" status: 200 len: 22494 microversion: 2.20 time: 0.171093 Feb 17 04:42:25.489594 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 371/743] 10.222.0.38 () {62 vars in 1309 bytes} [Wed Feb 17 04:42:25 2021] POST /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d/action => generated 22494 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 04:42:25.802252 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-778be6c2-90a0-4885-803d-bcdbda3512ec tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e476d21764ecfaf94b5f9a9d25b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b5af96686e409cb77e5a0aa9ac1fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:25.816474 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-778be6c2-90a0-4885-803d-bcdbda3512ec tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] 10.222.0.38 "GET /compute/v2.1/servers/3470f07e-b94c-42d4-afdf-917b1ffa6a4d" status: 200 len: 1313 microversion: 2.1 time: 0.588926 Feb 17 04:42:25.818092 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 373/744] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:42:25 2021] GET /compute/v2.1/servers/3470f07e-b94c-42d4-afdf-917b1ffa6a4d => generated 1313 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:42:26.502120 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-e1a6803e-1c33-4846-92f6-54c69738b647 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:42:26.503947 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-e1a6803e-1c33-4846-92f6-54c69738b647 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:26.513344 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e1a6803e-1c33-4846-92f6-54c69738b647 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:26.514117 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e1a6803e-1c33-4846-92f6-54c69738b647 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:26.515848 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e1a6803e-1c33-4846-92f6-54c69738b647 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:26.516707 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e1a6803e-1c33-4846-92f6-54c69738b647 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:26.641550 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-e1a6803e-1c33-4846-92f6-54c69738b647 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "POST /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d/action" status: 200 len: 23804 microversion: 2.20 time: 0.144100 Feb 17 04:42:26.642594 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 372/745] 10.222.0.38 () {62 vars in 1309 bytes} [Wed Feb 17 04:42:26 2021] POST /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d/action => generated 23804 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:42:26.835424 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-6affc389-617b-49f6-89ca-926134d2207f tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:26.836189 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-6affc389-617b-49f6-89ca-926134d2207f tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] [instance: 3470f07e-b94c-42d4-afdf-917b1ffa6a4d] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:26.845452 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6affc389-617b-49f6-89ca-926134d2207f tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:26.846063 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6affc389-617b-49f6-89ca-926134d2207f tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:26.847024 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6affc389-617b-49f6-89ca-926134d2207f tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:26.847709 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6affc389-617b-49f6-89ca-926134d2207f tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:27.082323 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-6affc389-617b-49f6-89ca-926134d2207f tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e476d21764ecfaf94b5f9a9d25b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b5af96686e409cb77e5a0aa9ac1fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:27.091506 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-6affc389-617b-49f6-89ca-926134d2207f tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] 10.222.0.38 "GET /compute/v2.1/servers/3470f07e-b94c-42d4-afdf-917b1ffa6a4d" status: 200 len: 1313 microversion: 2.1 time: 0.260285 Feb 17 04:42:27.092697 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 374/746] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:42:26 2021] GET /compute/v2.1/servers/3470f07e-b94c-42d4-afdf-917b1ffa6a4d => generated 1313 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:42:27.654546 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-e19af325-8529-42eb-bffb-f44c9e793111 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:42:27.656308 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-e19af325-8529-42eb-bffb-f44c9e793111 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:27.665323 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e19af325-8529-42eb-bffb-f44c9e793111 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:27.665833 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e19af325-8529-42eb-bffb-f44c9e793111 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:27.666716 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e19af325-8529-42eb-bffb-f44c9e793111 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:27.667213 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e19af325-8529-42eb-bffb-f44c9e793111 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:27.787936 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-e19af325-8529-42eb-bffb-f44c9e793111 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "POST /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d/action" status: 200 len: 25379 microversion: 2.20 time: 0.137694 Feb 17 04:42:27.788949 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 373/747] 10.222.0.38 () {62 vars in 1309 bytes} [Wed Feb 17 04:42:27 2021] POST /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d/action => generated 25379 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:42:28.110986 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-d63c79e5-da3e-48b2-95fa-8dc559b76de8 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:28.112988 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-d63c79e5-da3e-48b2-95fa-8dc559b76de8 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] [instance: 3470f07e-b94c-42d4-afdf-917b1ffa6a4d] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:28.121248 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d63c79e5-da3e-48b2-95fa-8dc559b76de8 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:28.121763 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d63c79e5-da3e-48b2-95fa-8dc559b76de8 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:28.122699 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d63c79e5-da3e-48b2-95fa-8dc559b76de8 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:28.123201 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d63c79e5-da3e-48b2-95fa-8dc559b76de8 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:28.363925 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-d63c79e5-da3e-48b2-95fa-8dc559b76de8 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e476d21764ecfaf94b5f9a9d25b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b5af96686e409cb77e5a0aa9ac1fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:28.374137 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-d63c79e5-da3e-48b2-95fa-8dc559b76de8 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] 10.222.0.38 "GET /compute/v2.1/servers/3470f07e-b94c-42d4-afdf-917b1ffa6a4d" status: 200 len: 1313 microversion: 2.1 time: 0.268294 Feb 17 04:42:28.375499 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 375/748] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:42:28 2021] GET /compute/v2.1/servers/3470f07e-b94c-42d4-afdf-917b1ffa6a4d => generated 1313 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:42:28.804633 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-67f1bccb-042a-4294-9eab-d756e31b69f3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:42:28.806772 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-67f1bccb-042a-4294-9eab-d756e31b69f3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:28.818536 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-67f1bccb-042a-4294-9eab-d756e31b69f3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:28.819459 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-67f1bccb-042a-4294-9eab-d756e31b69f3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:28.820540 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-67f1bccb-042a-4294-9eab-d756e31b69f3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:28.821247 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-67f1bccb-042a-4294-9eab-d756e31b69f3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:28.981407 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-67f1bccb-042a-4294-9eab-d756e31b69f3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "POST /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d/action" status: 200 len: 26921 microversion: 2.20 time: 0.181959 Feb 17 04:42:28.983310 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 374/749] 10.222.0.38 () {62 vars in 1309 bytes} [Wed Feb 17 04:42:28 2021] POST /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d/action => generated 26921 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:42:29.273460 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [req-d59b2876-314c-4cc0-8627-83ebf95f9fa9 req-9fc61976-7297-4c03-97b1-8119fc17469a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3470f07e-b94c-42d4-afdf-917b1ffa6a4d", "name": "network-vif-plugged", "status": "completed", "tag": "a4af3de5-d823-4909-ba1c-870f8e598dbe"}]} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:42:29.283002 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:42:29.283002 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:42:29.302308 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-d59b2876-314c-4cc0-8627-83ebf95f9fa9 req-9fc61976-7297-4c03-97b1-8119fc17469a service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:29.303200 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-d59b2876-314c-4cc0-8627-83ebf95f9fa9 req-9fc61976-7297-4c03-97b1-8119fc17469a service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:29.323178 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.compute.server_external_events [req-d59b2876-314c-4cc0-8627-83ebf95f9fa9 req-9fc61976-7297-4c03-97b1-8119fc17469a service nova] Creating event network-vif-plugged:a4af3de5-d823-4909-ba1c-870f8e598dbe for instance 3470f07e-b94c-42d4-afdf-917b1ffa6a4d on hv-cinder-76019 Feb 17 04:42:29.329543 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [req-d59b2876-314c-4cc0-8627-83ebf95f9fa9 req-9fc61976-7297-4c03-97b1-8119fc17469a service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064617 Feb 17 04:42:29.330249 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 376/750] 10.222.0.38 () {64 vars in 1308 bytes} [Wed Feb 17 04:42:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:42:29.396576 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-749b62a8-3ab2-4350-b57a-7b483ddcc48e tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:29.397267 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-749b62a8-3ab2-4350-b57a-7b483ddcc48e tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] [instance: 3470f07e-b94c-42d4-afdf-917b1ffa6a4d] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:29.407856 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-749b62a8-3ab2-4350-b57a-7b483ddcc48e tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:29.408374 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-749b62a8-3ab2-4350-b57a-7b483ddcc48e tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:29.409223 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-749b62a8-3ab2-4350-b57a-7b483ddcc48e tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:29.409718 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-749b62a8-3ab2-4350-b57a-7b483ddcc48e tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:29.768403 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-749b62a8-3ab2-4350-b57a-7b483ddcc48e tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e476d21764ecfaf94b5f9a9d25b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b5af96686e409cb77e5a0aa9ac1fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:29.783124 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-749b62a8-3ab2-4350-b57a-7b483ddcc48e tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] 10.222.0.38 "GET /compute/v2.1/servers/3470f07e-b94c-42d4-afdf-917b1ffa6a4d" status: 200 len: 1313 microversion: 2.1 time: 0.392627 Feb 17 04:42:29.783756 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 375/751] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:42:29 2021] GET /compute/v2.1/servers/3470f07e-b94c-42d4-afdf-917b1ffa6a4d => generated 1313 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:42:29.996963 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-6399150c-1a1d-4355-b7d0-bcdf170940bd tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:42:29.998088 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-6399150c-1a1d-4355-b7d0-bcdf170940bd tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:30.019492 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6399150c-1a1d-4355-b7d0-bcdf170940bd tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:30.020276 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6399150c-1a1d-4355-b7d0-bcdf170940bd tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:30.021293 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6399150c-1a1d-4355-b7d0-bcdf170940bd tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:30.021930 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6399150c-1a1d-4355-b7d0-bcdf170940bd tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:30.181497 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-6399150c-1a1d-4355-b7d0-bcdf170940bd tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "POST /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d/action" status: 200 len: 27875 microversion: 2.20 time: 0.188643 Feb 17 04:42:30.182904 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 377/752] 10.222.0.38 () {62 vars in 1309 bytes} [Wed Feb 17 04:42:29 2021] POST /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d/action => generated 27875 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:42:30.801443 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-c03c41d0-2cdd-45a9-a105-42404d80a5d1 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:30.802112 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-c03c41d0-2cdd-45a9-a105-42404d80a5d1 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] [instance: 3470f07e-b94c-42d4-afdf-917b1ffa6a4d] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:30.818041 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c03c41d0-2cdd-45a9-a105-42404d80a5d1 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:30.818554 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c03c41d0-2cdd-45a9-a105-42404d80a5d1 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:30.828600 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c03c41d0-2cdd-45a9-a105-42404d80a5d1 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:30.830658 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c03c41d0-2cdd-45a9-a105-42404d80a5d1 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:31.195049 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-e569b1de-4f88-4710-9e21-3a04037f373e tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:42:31.196188 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-e569b1de-4f88-4710-9e21-3a04037f373e tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:31.221218 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e569b1de-4f88-4710-9e21-3a04037f373e tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:31.221739 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e569b1de-4f88-4710-9e21-3a04037f373e tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:31.227723 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e569b1de-4f88-4710-9e21-3a04037f373e tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:31.228399 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e569b1de-4f88-4710-9e21-3a04037f373e tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:31.317286 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-c03c41d0-2cdd-45a9-a105-42404d80a5d1 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e476d21764ecfaf94b5f9a9d25b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b5af96686e409cb77e5a0aa9ac1fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:31.328179 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-c03c41d0-2cdd-45a9-a105-42404d80a5d1 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] 10.222.0.38 "GET /compute/v2.1/servers/3470f07e-b94c-42d4-afdf-917b1ffa6a4d" status: 200 len: 1313 microversion: 2.1 time: 0.530080 Feb 17 04:42:31.333284 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 376/753] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:42:30 2021] GET /compute/v2.1/servers/3470f07e-b94c-42d4-afdf-917b1ffa6a4d => generated 1313 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:42:31.421375 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-e569b1de-4f88-4710-9e21-3a04037f373e tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "POST /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d/action" status: 200 len: 28243 microversion: 2.20 time: 0.230634 Feb 17 04:42:31.428753 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 378/754] 10.222.0.38 () {62 vars in 1309 bytes} [Wed Feb 17 04:42:31 2021] POST /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d/action => generated 28243 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:42:32.350524 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-e851e885-04d9-4767-8e08-786451a3d077 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:32.352059 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-e851e885-04d9-4767-8e08-786451a3d077 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] [instance: 3470f07e-b94c-42d4-afdf-917b1ffa6a4d] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:32.364252 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e851e885-04d9-4767-8e08-786451a3d077 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:32.364875 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e851e885-04d9-4767-8e08-786451a3d077 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:32.365808 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e851e885-04d9-4767-8e08-786451a3d077 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:32.366975 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e851e885-04d9-4767-8e08-786451a3d077 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:32.437147 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-84b1c1f7-3f01-4857-95a4-8fcd7113ac9c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:42:32.445288 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-84b1c1f7-3f01-4857-95a4-8fcd7113ac9c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:32.469444 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-84b1c1f7-3f01-4857-95a4-8fcd7113ac9c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:32.470183 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-84b1c1f7-3f01-4857-95a4-8fcd7113ac9c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:32.471294 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-84b1c1f7-3f01-4857-95a4-8fcd7113ac9c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:32.471973 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-84b1c1f7-3f01-4857-95a4-8fcd7113ac9c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:32.623872 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-e851e885-04d9-4767-8e08-786451a3d077 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e476d21764ecfaf94b5f9a9d25b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b5af96686e409cb77e5a0aa9ac1fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:32.634433 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-e851e885-04d9-4767-8e08-786451a3d077 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] 10.222.0.38 "GET /compute/v2.1/servers/3470f07e-b94c-42d4-afdf-917b1ffa6a4d" status: 200 len: 1497 microversion: 2.1 time: 0.287728 Feb 17 04:42:32.635101 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 377/755] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:42:32 2021] GET /compute/v2.1/servers/3470f07e-b94c-42d4-afdf-917b1ffa6a4d => generated 1497 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:42:32.661296 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-84b1c1f7-3f01-4857-95a4-8fcd7113ac9c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "POST /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d/action" status: 200 len: 28243 microversion: 2.20 time: 0.229864 Feb 17 04:42:32.661993 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 379/756] 10.222.0.38 () {62 vars in 1309 bytes} [Wed Feb 17 04:42:32 2021] POST /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d/action => generated 28243 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 04:42:33.588147 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-6bb986c8-33bc-4bee-90af-afcd733ee9c9 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:33.589561 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-6bb986c8-33bc-4bee-90af-afcd733ee9c9 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] [instance: 3470f07e-b94c-42d4-afdf-917b1ffa6a4d] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:33.601042 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6bb986c8-33bc-4bee-90af-afcd733ee9c9 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:33.601763 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6bb986c8-33bc-4bee-90af-afcd733ee9c9 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:33.602829 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6bb986c8-33bc-4bee-90af-afcd733ee9c9 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:33.603464 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6bb986c8-33bc-4bee-90af-afcd733ee9c9 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:33.700063 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-6bb986c8-33bc-4bee-90af-afcd733ee9c9 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] [instance: 3470f07e-b94c-42d4-afdf-917b1ffa6a4d] Going to try to terminate instance {{(pid=98080) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 04:42:33.762161 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-65aaedbc-023a-4d4e-97b7-4627cf64c46a tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Action: 'create', calling method: .version_select at 0x7fc2ea935730>, body: {"keypair": {"name": "tempest-TestShelveInstance-1943374732"}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:42:33.793361 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.quota [None req-65aaedbc-023a-4d4e-97b7-4627cf64c46a tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Getting quotas for project ca59cfbe7f3b494499cc8efe1d0e093e. Resources: {'key_pairs'} {{(pid=98081) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:42:33.798127 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.quota [None req-65aaedbc-023a-4d4e-97b7-4627cf64c46a tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Getting quotas for user 82cd0aa08bfc4637a988f25eec8cfb41 and project ca59cfbe7f3b494499cc8efe1d0e093e. Resources: {'key_pairs'} {{(pid=98081) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:42:33.853726 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-6bb986c8-33bc-4bee-90af-afcd733ee9c9 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] 10.222.0.38 "DELETE /compute/v2.1/servers/3470f07e-b94c-42d4-afdf-917b1ffa6a4d" status: 204 len: 0 microversion: 2.1 time: 0.270981 Feb 17 04:42:33.854927 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 380/757] 10.222.0.38 () {58 vars in 1229 bytes} [Wed Feb 17 04:42:33 2021] DELETE /compute/v2.1/servers/3470f07e-b94c-42d4-afdf-917b1ffa6a4d => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 17 04:42:33.861793 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-61dc74d7-fbda-4a35-b271-a8b4b5aee511 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:42:33.863228 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-61dc74d7-fbda-4a35-b271-a8b4b5aee511 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:33.876862 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-61dc74d7-fbda-4a35-b271-a8b4b5aee511 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:33.877815 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-61dc74d7-fbda-4a35-b271-a8b4b5aee511 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:33.879355 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-61dc74d7-fbda-4a35-b271-a8b4b5aee511 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:33.880010 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-61dc74d7-fbda-4a35-b271-a8b4b5aee511 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:34.022675 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-61dc74d7-fbda-4a35-b271-a8b4b5aee511 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "POST /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d/action" status: 200 len: 28534 microversion: 2.20 time: 0.165951 Feb 17 04:42:34.024751 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 381/758] 10.222.0.38 () {62 vars in 1309 bytes} [Wed Feb 17 04:42:33 2021] POST /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d/action => generated 28534 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:42:34.032581 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-55f07ffa-4d26-470f-95a3-a4645e1a2c4d tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:34.033442 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-55f07ffa-4d26-470f-95a3-a4645e1a2c4d tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] [instance: 3470f07e-b94c-42d4-afdf-917b1ffa6a4d] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:34.042927 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-55f07ffa-4d26-470f-95a3-a4645e1a2c4d tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:34.043609 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-55f07ffa-4d26-470f-95a3-a4645e1a2c4d tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:34.044493 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-55f07ffa-4d26-470f-95a3-a4645e1a2c4d tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:34.045006 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-55f07ffa-4d26-470f-95a3-a4645e1a2c4d tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:34.182368 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.quota [None req-65aaedbc-023a-4d4e-97b7-4627cf64c46a tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Getting quotas for project ca59cfbe7f3b494499cc8efe1d0e093e. Resources: {'key_pairs'} {{(pid=98081) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:42:34.186716 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.quota [None req-65aaedbc-023a-4d4e-97b7-4627cf64c46a tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Getting quotas for user 82cd0aa08bfc4637a988f25eec8cfb41 and project ca59cfbe7f3b494499cc8efe1d0e093e. Resources: {'key_pairs'} {{(pid=98081) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:42:34.200582 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-65aaedbc-023a-4d4e-97b7-4627cf64c46a tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] 10.222.0.38 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.688358 Feb 17 04:42:34.201438 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 378/759] 10.222.0.38 () {60 vars in 1148 bytes} [Wed Feb 17 04:42:33 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:42:34.212076 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-eefe75ed-514e-4fd9-be49-712328c80a5d tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Action: 'create', calling method: .version_select at 0x7fc2e9fa18c8>, body: {"security_group": {"name": "tempest-TestShelveInstance-645413079", "description": "tempest-TestShelveInstance-645413079 description"}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:42:34.297516 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-55f07ffa-4d26-470f-95a3-a4645e1a2c4d tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e476d21764ecfaf94b5f9a9d25b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b5af96686e409cb77e5a0aa9ac1fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:34.307503 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-55f07ffa-4d26-470f-95a3-a4645e1a2c4d tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] 10.222.0.38 "GET /compute/v2.1/servers/3470f07e-b94c-42d4-afdf-917b1ffa6a4d" status: 200 len: 1503 microversion: 2.1 time: 0.280801 Feb 17 04:42:34.308287 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 382/760] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:42:34 2021] GET /compute/v2.1/servers/3470f07e-b94c-42d4-afdf-917b1ffa6a4d => generated 1503 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:42:34.717714 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-eefe75ed-514e-4fd9-be49-712328c80a5d tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] 10.222.0.38 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.509522 Feb 17 04:42:34.718555 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 379/761] 10.222.0.38 () {60 vars in 1170 bytes} [Wed Feb 17 04:42:34 2021] POST /compute/v2.1/os-security-groups => generated 243 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:42:34.730603 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-8f9ad7bc-d20c-436f-a853-c70bb0a604d4 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Action: 'create', calling method: .version_select at 0x7fc2eaa80268>, body: {"security_group_rule": {"parent_group_id": "0b1b0d00-a62f-4b8a-bb68-8e9514059015", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "0.0.0.0/0"}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:42:34.948518 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-8f9ad7bc-d20c-436f-a853-c70bb0a604d4 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] 10.222.0.38 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.221966 Feb 17 04:42:34.951883 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 383/762] 10.222.0.38 () {60 vars in 1185 bytes} [Wed Feb 17 04:42:34 2021] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:42:34.960162 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-79edfdec-f845-4ce6-9dfb-d8be570fd81b tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Action: 'create', calling method: .version_select at 0x7fc2e9fa1a60>, body: {"security_group_rule": {"parent_group_id": "0b1b0d00-a62f-4b8a-bb68-8e9514059015", "ip_protocol": "icmp", "from_port": -1, "to_port": -1, "cidr": "0.0.0.0/0"}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:42:35.036057 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-9f3a71e9-e908-47e1-83b7-de8d85c9b7f4 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:42:35.037151 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-9f3a71e9-e908-47e1-83b7-de8d85c9b7f4 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:35.047031 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9f3a71e9-e908-47e1-83b7-de8d85c9b7f4 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:35.047556 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9f3a71e9-e908-47e1-83b7-de8d85c9b7f4 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:35.048412 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9f3a71e9-e908-47e1-83b7-de8d85c9b7f4 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:35.048913 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9f3a71e9-e908-47e1-83b7-de8d85c9b7f4 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:35.183188 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-79edfdec-f845-4ce6-9dfb-d8be570fd81b tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] 10.222.0.38 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.226822 Feb 17 04:42:35.184847 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 380/763] 10.222.0.38 () {60 vars in 1185 bytes} [Wed Feb 17 04:42:34 2021] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:42:35.188466 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-9f3a71e9-e908-47e1-83b7-de8d85c9b7f4 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "POST /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d/action" status: 200 len: 28702 microversion: 2.20 time: 0.156328 Feb 17 04:42:35.189107 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 384/764] 10.222.0.38 () {62 vars in 1309 bytes} [Wed Feb 17 04:42:35 2021] POST /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d/action => generated 28702 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:42:35.327493 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-7b884316-994e-45d9-bf07-c2295f6e98ec tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:35.328750 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-7b884316-994e-45d9-bf07-c2295f6e98ec tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] [instance: 3470f07e-b94c-42d4-afdf-917b1ffa6a4d] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:35.340423 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7b884316-994e-45d9-bf07-c2295f6e98ec tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:35.341225 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7b884316-994e-45d9-bf07-c2295f6e98ec tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:35.342543 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7b884316-994e-45d9-bf07-c2295f6e98ec tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:35.344215 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7b884316-994e-45d9-bf07-c2295f6e98ec tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:35.810655 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-7b884316-994e-45d9-bf07-c2295f6e98ec tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e476d21764ecfaf94b5f9a9d25b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b5af96686e409cb77e5a0aa9ac1fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:35.836829 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-7b884316-994e-45d9-bf07-c2295f6e98ec tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] 10.222.0.38 "GET /compute/v2.1/servers/3470f07e-b94c-42d4-afdf-917b1ffa6a4d" status: 200 len: 1503 microversion: 2.1 time: 0.513327 Feb 17 04:42:35.841522 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 381/765] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:42:35 2021] GET /compute/v2.1/servers/3470f07e-b94c-42d4-afdf-917b1ffa6a4d => generated 1503 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:42:36.044360 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [req-a10cf538-99c7-4230-a9d6-920f7f6c5e6e req-c11e5d50-d4a8-4adc-84ea-45c8979d8a58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3470f07e-b94c-42d4-afdf-917b1ffa6a4d", "name": "network-vif-unplugged", "status": "completed", "tag": "a4af3de5-d823-4909-ba1c-870f8e598dbe"}]} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:42:36.046911 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:42:36.046911 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:42:36.056801 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-a10cf538-99c7-4230-a9d6-920f7f6c5e6e req-c11e5d50-d4a8-4adc-84ea-45c8979d8a58 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:36.057492 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-a10cf538-99c7-4230-a9d6-920f7f6c5e6e req-c11e5d50-d4a8-4adc-84ea-45c8979d8a58 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:36.080950 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.compute.server_external_events [req-a10cf538-99c7-4230-a9d6-920f7f6c5e6e req-c11e5d50-d4a8-4adc-84ea-45c8979d8a58 service nova] Creating event network-vif-unplugged:a4af3de5-d823-4909-ba1c-870f8e598dbe for instance 3470f07e-b94c-42d4-afdf-917b1ffa6a4d on hv-cinder-76019 Feb 17 04:42:36.086759 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [req-a10cf538-99c7-4230-a9d6-920f7f6c5e6e req-c11e5d50-d4a8-4adc-84ea-45c8979d8a58 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046645 Feb 17 04:42:36.087826 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 385/766] 10.222.0.38 () {64 vars in 1308 bytes} [Wed Feb 17 04:42:36 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:42:36.202113 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-9ca5f0d5-5dc9-40d3-9d99-17278c0c9408 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:42:36.204689 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-9ca5f0d5-5dc9-40d3-9d99-17278c0c9408 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:36.212971 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9ca5f0d5-5dc9-40d3-9d99-17278c0c9408 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:36.213720 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9ca5f0d5-5dc9-40d3-9d99-17278c0c9408 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:36.214613 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9ca5f0d5-5dc9-40d3-9d99-17278c0c9408 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:36.215150 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9ca5f0d5-5dc9-40d3-9d99-17278c0c9408 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:36.329062 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-9ca5f0d5-5dc9-40d3-9d99-17278c0c9408 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "POST /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d/action" status: 200 len: 28702 microversion: 2.20 time: 0.131054 Feb 17 04:42:36.329762 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 382/767] 10.222.0.38 () {62 vars in 1309 bytes} [Wed Feb 17 04:42:36 2021] POST /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d/action => generated 28702 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:42:36.862241 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-3f0fc8a1-8ab6-4d76-a3ea-16087dcd1e20 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:36.863064 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-3f0fc8a1-8ab6-4d76-a3ea-16087dcd1e20 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] [instance: 3470f07e-b94c-42d4-afdf-917b1ffa6a4d] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:36.871318 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-3f0fc8a1-8ab6-4d76-a3ea-16087dcd1e20 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:36.872184 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-3f0fc8a1-8ab6-4d76-a3ea-16087dcd1e20 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:36.873094 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-3f0fc8a1-8ab6-4d76-a3ea-16087dcd1e20 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:36.873600 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-3f0fc8a1-8ab6-4d76-a3ea-16087dcd1e20 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:37.343809 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-3623add4-3a2a-4e19-b0e4-7d64d32c0d82 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:42:37.345322 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-3623add4-3a2a-4e19-b0e4-7d64d32c0d82 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:37.355737 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-3623add4-3a2a-4e19-b0e4-7d64d32c0d82 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:37.356724 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-3623add4-3a2a-4e19-b0e4-7d64d32c0d82 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:37.357840 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-3623add4-3a2a-4e19-b0e4-7d64d32c0d82 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:37.359207 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-3623add4-3a2a-4e19-b0e4-7d64d32c0d82 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:37.416536 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-3f0fc8a1-8ab6-4d76-a3ea-16087dcd1e20 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e476d21764ecfaf94b5f9a9d25b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b5af96686e409cb77e5a0aa9ac1fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:37.429435 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-3f0fc8a1-8ab6-4d76-a3ea-16087dcd1e20 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] 10.222.0.38 "GET /compute/v2.1/servers/3470f07e-b94c-42d4-afdf-917b1ffa6a4d" status: 200 len: 1503 microversion: 2.1 time: 0.572073 Feb 17 04:42:37.431086 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 386/768] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:42:36 2021] GET /compute/v2.1/servers/3470f07e-b94c-42d4-afdf-917b1ffa6a4d => generated 1503 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:42:37.483585 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-3623add4-3a2a-4e19-b0e4-7d64d32c0d82 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "POST /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d/action" status: 200 len: 28702 microversion: 2.20 time: 0.145314 Feb 17 04:42:37.484901 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 383/769] 10.222.0.38 () {62 vars in 1309 bytes} [Wed Feb 17 04:42:37 2021] POST /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d/action => generated 28702 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:42:37.680684 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [req-e12a12a9-b403-4bb6-8b86-43e534f77cce req-85f98487-6021-4603-bcef-8c1773d2a766 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3470f07e-b94c-42d4-afdf-917b1ffa6a4d", "name": "network-vif-deleted", "tag": "a4af3de5-d823-4909-ba1c-870f8e598dbe"}]} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:42:37.682904 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:42:37.682904 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:42:37.695614 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-e12a12a9-b403-4bb6-8b86-43e534f77cce req-85f98487-6021-4603-bcef-8c1773d2a766 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:37.696135 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-e12a12a9-b403-4bb6-8b86-43e534f77cce req-85f98487-6021-4603-bcef-8c1773d2a766 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:37.714846 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.compute.server_external_events [req-e12a12a9-b403-4bb6-8b86-43e534f77cce req-85f98487-6021-4603-bcef-8c1773d2a766 service nova] Creating event network-vif-deleted:a4af3de5-d823-4909-ba1c-870f8e598dbe for instance 3470f07e-b94c-42d4-afdf-917b1ffa6a4d on hv-cinder-76019 Feb 17 04:42:37.720293 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [req-e12a12a9-b403-4bb6-8b86-43e534f77cce req-85f98487-6021-4603-bcef-8c1773d2a766 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043552 Feb 17 04:42:37.721276 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 387/770] 10.222.0.38 () {64 vars in 1308 bytes} [Wed Feb 17 04:42:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:42:38.450154 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-93b2c8c2-3f2a-4303-8c70-d30458af1c3d tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:38.451043 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-93b2c8c2-3f2a-4303-8c70-d30458af1c3d tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] [instance: 3470f07e-b94c-42d4-afdf-917b1ffa6a4d] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:38.460756 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-93b2c8c2-3f2a-4303-8c70-d30458af1c3d tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:38.461250 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-93b2c8c2-3f2a-4303-8c70-d30458af1c3d tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:38.462116 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-93b2c8c2-3f2a-4303-8c70-d30458af1c3d tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:38.463658 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-93b2c8c2-3f2a-4303-8c70-d30458af1c3d tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:38.497251 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-1213e13a-0388-445c-a507-1273a913b631 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:42:38.498741 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-1213e13a-0388-445c-a507-1273a913b631 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:38.507858 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1213e13a-0388-445c-a507-1273a913b631 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:38.508656 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1213e13a-0388-445c-a507-1273a913b631 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:38.509514 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1213e13a-0388-445c-a507-1273a913b631 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:38.510007 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1213e13a-0388-445c-a507-1273a913b631 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:38.519151 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.wsgi [None req-93b2c8c2-3f2a-4303-8c70-d30458af1c3d tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] HTTP exception thrown: Instance 3470f07e-b94c-42d4-afdf-917b1ffa6a4d could not be found. Feb 17 04:42:38.520091 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-93b2c8c2-3f2a-4303-8c70-d30458af1c3d tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Returning 404 to user: Instance 3470f07e-b94c-42d4-afdf-917b1ffa6a4d could not be found. {{(pid=98081) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:42:38.521018 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-93b2c8c2-3f2a-4303-8c70-d30458af1c3d tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] 10.222.0.38 "GET /compute/v2.1/servers/3470f07e-b94c-42d4-afdf-917b1ffa6a4d" status: 404 len: 111 microversion: 2.1 time: 0.075483 Feb 17 04:42:38.521790 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 384/771] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:42:38 2021] GET /compute/v2.1/servers/3470f07e-b94c-42d4-afdf-917b1ffa6a4d => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:42:38.628552 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-1213e13a-0388-445c-a507-1273a913b631 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "POST /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d/action" status: 200 len: 28702 microversion: 2.20 time: 0.134749 Feb 17 04:42:38.629265 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 388/772] 10.222.0.38 () {62 vars in 1309 bytes} [Wed Feb 17 04:42:38 2021] POST /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d/action => generated 28702 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 04:42:38.659345 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-073742f4-66fb-4cc5-8217-7252093c234c tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-46378193", "imageRef": "2d6991a7-a1f0-444b-8fd5-d05558b5f9a4", "flavorRef": "452", "networks": [{"uuid": "c6a84f22-8956-4c6c-8e1a-35ad1301db27"}]}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:42:38.726923 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.network.neutron [None req-073742f4-66fb-4cc5-8217-7252093c234c tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] validate_networks() for [('c6a84f22-8956-4c6c-8e1a-35ad1301db27', None, None, None)] {{(pid=98081) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 04:42:39.468575 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-073742f4-66fb-4cc5-8217-7252093c234c tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Flavor limits 0:0:0 {{(pid=98081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 04:42:39.469064 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-073742f4-66fb-4cc5-8217-7252093c234c tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Image limits 0:0:0 {{(pid=98081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 04:42:39.469571 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-073742f4-66fb-4cc5-8217-7252093c234c tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Flavor pref 0:0:0 {{(pid=98081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 04:42:39.470034 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-073742f4-66fb-4cc5-8217-7252093c234c tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Image pref 0:0:0 {{(pid=98081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 04:42:39.470500 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-073742f4-66fb-4cc5-8217-7252093c234c tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 04:42:39.479481 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-073742f4-66fb-4cc5-8217-7252093c234c tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:39.480030 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-073742f4-66fb-4cc5-8217-7252093c234c tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:39.480906 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-073742f4-66fb-4cc5-8217-7252093c234c tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:39.481573 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-073742f4-66fb-4cc5-8217-7252093c234c tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:39.500659 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.quota [None req-073742f4-66fb-4cc5-8217-7252093c234c tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Getting quotas for project 21b5af96686e409cb77e5a0aa9ac1fb8. Resources: {'instances', 'cores', 'ram'} {{(pid=98081) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:42:39.505083 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.quota [None req-073742f4-66fb-4cc5-8217-7252093c234c tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Getting quotas for user e26e476d21764ecfaf94b5f9a9d25b6b and project 21b5af96686e409cb77e5a0aa9ac1fb8. Resources: {'instances', 'cores', 'ram'} {{(pid=98081) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:42:39.516766 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-073742f4-66fb-4cc5-8217-7252093c234c tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Going to run 1 instances... {{(pid=98081) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 04:42:39.519390 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-073742f4-66fb-4cc5-8217-7252093c234c tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] [instance: 2d5996f2-39d5-43b5-878f-920d0b4401b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d6991a7-a1f0-444b-8fd5-d05558b5f9a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98081) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 04:42:39.578303 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-073742f4-66fb-4cc5-8217-7252093c234c tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] 10.222.0.38 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.922622 Feb 17 04:42:39.579719 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 385/773] 10.222.0.38 () {60 vars in 1137 bytes} [Wed Feb 17 04:42:38 2021] POST /compute/v2.1/servers => generated 380 bytes in 925 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 17 04:42:39.590784 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-5600ce80-a471-42f8-9c2a-1f0d14ec46da tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:39.591751 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-5600ce80-a471-42f8-9c2a-1f0d14ec46da tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] [instance: 2d5996f2-39d5-43b5-878f-920d0b4401b9] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:39.641893 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-478425e7-4ec5-4c5b-80ad-99eccf1faea3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:42:39.643391 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-478425e7-4ec5-4c5b-80ad-99eccf1faea3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:39.651788 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-478425e7-4ec5-4c5b-80ad-99eccf1faea3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:39.652347 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-478425e7-4ec5-4c5b-80ad-99eccf1faea3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:39.653219 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-478425e7-4ec5-4c5b-80ad-99eccf1faea3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:39.653720 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-478425e7-4ec5-4c5b-80ad-99eccf1faea3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:39.678025 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-5600ce80-a471-42f8-9c2a-1f0d14ec46da tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e476d21764ecfaf94b5f9a9d25b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b5af96686e409cb77e5a0aa9ac1fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:39.686701 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-5600ce80-a471-42f8-9c2a-1f0d14ec46da tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] 10.222.0.38 "GET /compute/v2.1/servers/2d5996f2-39d5-43b5-878f-920d0b4401b9" status: 200 len: 1212 microversion: 2.1 time: 0.100339 Feb 17 04:42:39.687362 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 389/774] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:42:39 2021] GET /compute/v2.1/servers/2d5996f2-39d5-43b5-878f-920d0b4401b9 => generated 1212 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:42:39.776464 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-478425e7-4ec5-4c5b-80ad-99eccf1faea3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "POST /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d/action" status: 200 len: 30551 microversion: 2.20 time: 0.138649 Feb 17 04:42:39.777181 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 386/775] 10.222.0.38 () {62 vars in 1309 bytes} [Wed Feb 17 04:42:39 2021] POST /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d/action => generated 30551 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 04:42:40.704642 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-ae331b17-667b-4bcc-8ddb-7505c78fc779 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:40.705374 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-ae331b17-667b-4bcc-8ddb-7505c78fc779 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] [instance: 2d5996f2-39d5-43b5-878f-920d0b4401b9] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:40.715096 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ae331b17-667b-4bcc-8ddb-7505c78fc779 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:40.715981 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ae331b17-667b-4bcc-8ddb-7505c78fc779 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:40.717420 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ae331b17-667b-4bcc-8ddb-7505c78fc779 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:40.718187 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ae331b17-667b-4bcc-8ddb-7505c78fc779 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:40.791025 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-d2aa8703-6833-444d-9330-f6f5c563787a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:42:40.792166 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-d2aa8703-6833-444d-9330-f6f5c563787a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:40.801376 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d2aa8703-6833-444d-9330-f6f5c563787a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:40.801895 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d2aa8703-6833-444d-9330-f6f5c563787a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:40.802779 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d2aa8703-6833-444d-9330-f6f5c563787a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:40.803278 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d2aa8703-6833-444d-9330-f6f5c563787a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:40.926349 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-d2aa8703-6833-444d-9330-f6f5c563787a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "POST /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d/action" status: 200 len: 32185 microversion: 2.20 time: 0.140000 Feb 17 04:42:40.930631 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 387/776] 10.222.0.38 () {62 vars in 1309 bytes} [Wed Feb 17 04:42:40 2021] POST /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d/action => generated 32185 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:42:40.935263 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-ae331b17-667b-4bcc-8ddb-7505c78fc779 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e476d21764ecfaf94b5f9a9d25b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b5af96686e409cb77e5a0aa9ac1fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:40.945047 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-ae331b17-667b-4bcc-8ddb-7505c78fc779 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] 10.222.0.38 "GET /compute/v2.1/servers/2d5996f2-39d5-43b5-878f-920d0b4401b9" status: 200 len: 1282 microversion: 2.1 time: 0.244701 Feb 17 04:42:40.955705 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 390/777] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:42:40 2021] GET /compute/v2.1/servers/2d5996f2-39d5-43b5-878f-920d0b4401b9 => generated 1282 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:42:41.941170 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-f05f941a-c9e9-4e02-8fed-dc760e84f2ce tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:42:41.942550 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-f05f941a-c9e9-4e02-8fed-dc760e84f2ce tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:41.952931 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f05f941a-c9e9-4e02-8fed-dc760e84f2ce tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:41.953439 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f05f941a-c9e9-4e02-8fed-dc760e84f2ce tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:41.954616 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f05f941a-c9e9-4e02-8fed-dc760e84f2ce tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:41.954962 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f05f941a-c9e9-4e02-8fed-dc760e84f2ce tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:41.963356 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-d4578a23-84a0-4521-9d19-da469231ffeb tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:41.964302 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-d4578a23-84a0-4521-9d19-da469231ffeb tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] [instance: 2d5996f2-39d5-43b5-878f-920d0b4401b9] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:41.975997 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d4578a23-84a0-4521-9d19-da469231ffeb tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:41.976797 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d4578a23-84a0-4521-9d19-da469231ffeb tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:41.977811 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d4578a23-84a0-4521-9d19-da469231ffeb tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:41.978452 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d4578a23-84a0-4521-9d19-da469231ffeb tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:42.071434 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-f05f941a-c9e9-4e02-8fed-dc760e84f2ce tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "POST /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d/action" status: 200 len: 33406 microversion: 2.20 time: 0.135219 Feb 17 04:42:42.076266 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 388/778] 10.222.0.38 () {62 vars in 1309 bytes} [Wed Feb 17 04:42:41 2021] POST /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d/action => generated 33406 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:42:42.344652 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-d4578a23-84a0-4521-9d19-da469231ffeb tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e476d21764ecfaf94b5f9a9d25b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b5af96686e409cb77e5a0aa9ac1fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:42.353551 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-d4578a23-84a0-4521-9d19-da469231ffeb tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] 10.222.0.38 "GET /compute/v2.1/servers/2d5996f2-39d5-43b5-878f-920d0b4401b9" status: 200 len: 1312 microversion: 2.1 time: 0.394244 Feb 17 04:42:42.354174 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 391/779] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:42:41 2021] GET /compute/v2.1/servers/2d5996f2-39d5-43b5-878f-920d0b4401b9 => generated 1312 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:42:43.085516 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-62c66de4-41fd-4a27-b98f-6a7476232f25 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:42:43.086914 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-62c66de4-41fd-4a27-b98f-6a7476232f25 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:43.096246 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-62c66de4-41fd-4a27-b98f-6a7476232f25 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:43.096772 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-62c66de4-41fd-4a27-b98f-6a7476232f25 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:43.097608 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-62c66de4-41fd-4a27-b98f-6a7476232f25 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:43.098287 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-62c66de4-41fd-4a27-b98f-6a7476232f25 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:43.222601 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-62c66de4-41fd-4a27-b98f-6a7476232f25 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "POST /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d/action" status: 200 len: 34279 microversion: 2.20 time: 0.141452 Feb 17 04:42:43.223326 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 389/780] 10.222.0.38 () {62 vars in 1309 bytes} [Wed Feb 17 04:42:43 2021] POST /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d/action => generated 34279 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:42:43.372947 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-fdba7766-8e6b-49a3-bfc9-a867d57bb27b tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:43.373746 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-fdba7766-8e6b-49a3-bfc9-a867d57bb27b tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] [instance: 2d5996f2-39d5-43b5-878f-920d0b4401b9] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:43.382829 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-fdba7766-8e6b-49a3-bfc9-a867d57bb27b tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:43.383391 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-fdba7766-8e6b-49a3-bfc9-a867d57bb27b tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:43.384238 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-fdba7766-8e6b-49a3-bfc9-a867d57bb27b tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:43.384738 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-fdba7766-8e6b-49a3-bfc9-a867d57bb27b tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:43.696790 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [req-daf53468-337f-466a-978a-e4c56f2e7c34 req-b83b6088-fdae-4059-9b1f-c734e2c9ce8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d5996f2-39d5-43b5-878f-920d0b4401b9", "tag": "be972db2-4143-4b74-9ace-aed5ef844f2b"}]} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:42:43.698855 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:42:43.698855 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:42:43.711330 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-daf53468-337f-466a-978a-e4c56f2e7c34 req-b83b6088-fdae-4059-9b1f-c734e2c9ce8f service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:43.712196 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-daf53468-337f-466a-978a-e4c56f2e7c34 req-b83b6088-fdae-4059-9b1f-c734e2c9ce8f service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:43.731464 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.compute.server_external_events [req-daf53468-337f-466a-978a-e4c56f2e7c34 req-b83b6088-fdae-4059-9b1f-c734e2c9ce8f service nova] Creating event network-changed:be972db2-4143-4b74-9ace-aed5ef844f2b for instance 2d5996f2-39d5-43b5-878f-920d0b4401b9 on hv-cinder-76019 Feb 17 04:42:43.737114 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [req-daf53468-337f-466a-978a-e4c56f2e7c34 req-b83b6088-fdae-4059-9b1f-c734e2c9ce8f service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045573 Feb 17 04:42:43.737980 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 390/781] 10.222.0.38 () {64 vars in 1308 bytes} [Wed Feb 17 04:42:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:42:43.819627 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-fdba7766-8e6b-49a3-bfc9-a867d57bb27b tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e476d21764ecfaf94b5f9a9d25b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b5af96686e409cb77e5a0aa9ac1fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:43.829009 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-fdba7766-8e6b-49a3-bfc9-a867d57bb27b tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] 10.222.0.38 "GET /compute/v2.1/servers/2d5996f2-39d5-43b5-878f-920d0b4401b9" status: 200 len: 1312 microversion: 2.1 time: 0.460068 Feb 17 04:42:43.829627 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 392/782] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:42:43 2021] GET /compute/v2.1/servers/2d5996f2-39d5-43b5-878f-920d0b4401b9 => generated 1312 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:42:44.236117 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-94552d86-f332-41c7-a880-463cac5b6742 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:42:44.237265 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-94552d86-f332-41c7-a880-463cac5b6742 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:44.245495 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-94552d86-f332-41c7-a880-463cac5b6742 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:44.246025 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-94552d86-f332-41c7-a880-463cac5b6742 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:44.246913 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-94552d86-f332-41c7-a880-463cac5b6742 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:44.247418 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-94552d86-f332-41c7-a880-463cac5b6742 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:44.364378 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-94552d86-f332-41c7-a880-463cac5b6742 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "POST /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d/action" status: 200 len: 35315 microversion: 2.20 time: 0.132600 Feb 17 04:42:44.365100 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 391/783] 10.222.0.38 () {62 vars in 1309 bytes} [Wed Feb 17 04:42:44 2021] POST /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d/action => generated 35315 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:42:44.847367 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-0673b9fd-3ebd-4ed4-823a-8e14c8bafc1f tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:44.848268 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-0673b9fd-3ebd-4ed4-823a-8e14c8bafc1f tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] [instance: 2d5996f2-39d5-43b5-878f-920d0b4401b9] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:44.856248 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0673b9fd-3ebd-4ed4-823a-8e14c8bafc1f tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:44.856756 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0673b9fd-3ebd-4ed4-823a-8e14c8bafc1f tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:44.857603 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0673b9fd-3ebd-4ed4-823a-8e14c8bafc1f tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:44.858101 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0673b9fd-3ebd-4ed4-823a-8e14c8bafc1f tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:45.231664 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-0673b9fd-3ebd-4ed4-823a-8e14c8bafc1f tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e476d21764ecfaf94b5f9a9d25b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b5af96686e409cb77e5a0aa9ac1fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:45.245907 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-0673b9fd-3ebd-4ed4-823a-8e14c8bafc1f tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] 10.222.0.38 "GET /compute/v2.1/servers/2d5996f2-39d5-43b5-878f-920d0b4401b9" status: 200 len: 1312 microversion: 2.1 time: 0.402680 Feb 17 04:42:45.247158 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 393/784] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:42:44 2021] GET /compute/v2.1/servers/2d5996f2-39d5-43b5-878f-920d0b4401b9 => generated 1312 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:42:45.378332 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-5e2af86d-2558-4af1-8010-5dc8de31a6b8 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:42:45.379544 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-5e2af86d-2558-4af1-8010-5dc8de31a6b8 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:45.388172 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5e2af86d-2558-4af1-8010-5dc8de31a6b8 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:45.388689 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5e2af86d-2558-4af1-8010-5dc8de31a6b8 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:45.390144 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5e2af86d-2558-4af1-8010-5dc8de31a6b8 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:45.390680 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5e2af86d-2558-4af1-8010-5dc8de31a6b8 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:45.507231 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-5e2af86d-2558-4af1-8010-5dc8de31a6b8 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "POST /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d/action" status: 200 len: 36096 microversion: 2.20 time: 0.133884 Feb 17 04:42:45.507949 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 392/785] 10.222.0.38 () {62 vars in 1309 bytes} [Wed Feb 17 04:42:45 2021] POST /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d/action => generated 36096 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:42:46.266408 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-f35713c9-4d3d-4d1e-a4ab-d01ccbb1be5f tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:46.267148 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-f35713c9-4d3d-4d1e-a4ab-d01ccbb1be5f tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] [instance: 2d5996f2-39d5-43b5-878f-920d0b4401b9] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:46.274991 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f35713c9-4d3d-4d1e-a4ab-d01ccbb1be5f tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:46.275504 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f35713c9-4d3d-4d1e-a4ab-d01ccbb1be5f tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:46.276341 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f35713c9-4d3d-4d1e-a4ab-d01ccbb1be5f tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:46.276834 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f35713c9-4d3d-4d1e-a4ab-d01ccbb1be5f tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:46.522066 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-07a695f6-bff3-4865-a26f-1fadc2d49c46 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:42:46.523333 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-07a695f6-bff3-4865-a26f-1fadc2d49c46 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:46.533425 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-07a695f6-bff3-4865-a26f-1fadc2d49c46 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:46.534045 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-07a695f6-bff3-4865-a26f-1fadc2d49c46 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:46.534939 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-07a695f6-bff3-4865-a26f-1fadc2d49c46 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:46.535434 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-07a695f6-bff3-4865-a26f-1fadc2d49c46 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:46.655631 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-07a695f6-bff3-4865-a26f-1fadc2d49c46 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "POST /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d/action" status: 200 len: 37646 microversion: 2.20 time: 0.138016 Feb 17 04:42:46.660074 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 393/786] 10.222.0.38 () {62 vars in 1309 bytes} [Wed Feb 17 04:42:46 2021] POST /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d/action => generated 37646 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 04:42:46.730423 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-f35713c9-4d3d-4d1e-a4ab-d01ccbb1be5f tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e476d21764ecfaf94b5f9a9d25b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b5af96686e409cb77e5a0aa9ac1fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:46.741927 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-f35713c9-4d3d-4d1e-a4ab-d01ccbb1be5f tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] 10.222.0.38 "GET /compute/v2.1/servers/2d5996f2-39d5-43b5-878f-920d0b4401b9" status: 200 len: 1312 microversion: 2.1 time: 0.480402 Feb 17 04:42:46.743245 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 394/787] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:42:46 2021] GET /compute/v2.1/servers/2d5996f2-39d5-43b5-878f-920d0b4401b9 => generated 1312 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:42:47.668350 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-d42fe95c-ef5f-4b77-aee6-52b7f2427748 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:42:47.669532 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-d42fe95c-ef5f-4b77-aee6-52b7f2427748 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:47.678103 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d42fe95c-ef5f-4b77-aee6-52b7f2427748 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:47.678640 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d42fe95c-ef5f-4b77-aee6-52b7f2427748 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:47.679483 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d42fe95c-ef5f-4b77-aee6-52b7f2427748 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:47.679983 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d42fe95c-ef5f-4b77-aee6-52b7f2427748 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:47.765205 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-1af07336-d72f-4156-b54a-12cb820ed196 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:47.765837 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-1af07336-d72f-4156-b54a-12cb820ed196 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] [instance: 2d5996f2-39d5-43b5-878f-920d0b4401b9] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:47.774062 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1af07336-d72f-4156-b54a-12cb820ed196 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:47.774557 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1af07336-d72f-4156-b54a-12cb820ed196 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:47.775429 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1af07336-d72f-4156-b54a-12cb820ed196 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:47.775994 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1af07336-d72f-4156-b54a-12cb820ed196 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:47.797016 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-d42fe95c-ef5f-4b77-aee6-52b7f2427748 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "POST /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d/action" status: 200 len: 38260 microversion: 2.20 time: 0.132944 Feb 17 04:42:47.801483 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 394/788] 10.222.0.38 () {62 vars in 1309 bytes} [Wed Feb 17 04:42:47 2021] POST /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d/action => generated 38260 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:42:48.116989 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [req-3551d43b-ebae-4c6f-b5c2-047135de31c0 req-43cb7cf7-89ab-49c7-8dea-52054c453557 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d5996f2-39d5-43b5-878f-920d0b4401b9", "name": "network-vif-plugged", "status": "completed", "tag": "be972db2-4143-4b74-9ace-aed5ef844f2b"}]} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:42:48.118752 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:42:48.118752 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:42:48.129841 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-3551d43b-ebae-4c6f-b5c2-047135de31c0 req-43cb7cf7-89ab-49c7-8dea-52054c453557 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:48.130352 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-3551d43b-ebae-4c6f-b5c2-047135de31c0 req-43cb7cf7-89ab-49c7-8dea-52054c453557 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:48.138199 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-1af07336-d72f-4156-b54a-12cb820ed196 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e476d21764ecfaf94b5f9a9d25b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b5af96686e409cb77e5a0aa9ac1fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:48.147889 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-1af07336-d72f-4156-b54a-12cb820ed196 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] 10.222.0.38 "GET /compute/v2.1/servers/2d5996f2-39d5-43b5-878f-920d0b4401b9" status: 200 len: 1312 microversion: 2.1 time: 0.387289 Feb 17 04:42:48.148703 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 395/789] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:42:47 2021] GET /compute/v2.1/servers/2d5996f2-39d5-43b5-878f-920d0b4401b9 => generated 1312 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:42:48.148893 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.compute.server_external_events [req-3551d43b-ebae-4c6f-b5c2-047135de31c0 req-43cb7cf7-89ab-49c7-8dea-52054c453557 service nova] Creating event network-vif-plugged:be972db2-4143-4b74-9ace-aed5ef844f2b for instance 2d5996f2-39d5-43b5-878f-920d0b4401b9 on hv-cinder-76019 Feb 17 04:42:48.160148 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [req-3551d43b-ebae-4c6f-b5c2-047135de31c0 req-43cb7cf7-89ab-49c7-8dea-52054c453557 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048477 Feb 17 04:42:48.160820 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 395/790] 10.222.0.38 () {64 vars in 1308 bytes} [Wed Feb 17 04:42:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:42:48.810024 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-2c771dce-5406-4bfa-ae38-c77c146390f4 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:42:48.811239 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-2c771dce-5406-4bfa-ae38-c77c146390f4 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:48.818972 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2c771dce-5406-4bfa-ae38-c77c146390f4 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:48.819490 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2c771dce-5406-4bfa-ae38-c77c146390f4 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:48.820336 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2c771dce-5406-4bfa-ae38-c77c146390f4 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:48.820835 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2c771dce-5406-4bfa-ae38-c77c146390f4 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:48.922516 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-2c771dce-5406-4bfa-ae38-c77c146390f4 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "POST /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d/action" status: 200 len: 38260 microversion: 2.20 time: 0.116743 Feb 17 04:42:48.923245 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 396/791] 10.222.0.38 () {62 vars in 1309 bytes} [Wed Feb 17 04:42:48 2021] POST /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d/action => generated 38260 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:42:49.166544 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-3413b7a0-8e9b-4ad1-8c11-4daf04775f90 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:49.167361 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-3413b7a0-8e9b-4ad1-8c11-4daf04775f90 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] [instance: 2d5996f2-39d5-43b5-878f-920d0b4401b9] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:49.175695 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-3413b7a0-8e9b-4ad1-8c11-4daf04775f90 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:49.176200 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-3413b7a0-8e9b-4ad1-8c11-4daf04775f90 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:49.177038 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-3413b7a0-8e9b-4ad1-8c11-4daf04775f90 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:49.177530 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-3413b7a0-8e9b-4ad1-8c11-4daf04775f90 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:49.397682 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-3413b7a0-8e9b-4ad1-8c11-4daf04775f90 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e476d21764ecfaf94b5f9a9d25b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b5af96686e409cb77e5a0aa9ac1fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:49.406822 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-3413b7a0-8e9b-4ad1-8c11-4daf04775f90 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] 10.222.0.38 "GET /compute/v2.1/servers/2d5996f2-39d5-43b5-878f-920d0b4401b9" status: 200 len: 1312 microversion: 2.1 time: 0.245058 Feb 17 04:42:49.407484 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 396/792] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:42:49 2021] GET /compute/v2.1/servers/2d5996f2-39d5-43b5-878f-920d0b4401b9 => generated 1312 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:42:49.937162 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-0a4aae6d-e054-45d6-bbef-c0df880fa972 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:42:49.938330 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-0a4aae6d-e054-45d6-bbef-c0df880fa972 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:49.947203 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0a4aae6d-e054-45d6-bbef-c0df880fa972 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:49.947839 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0a4aae6d-e054-45d6-bbef-c0df880fa972 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:49.948700 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0a4aae6d-e054-45d6-bbef-c0df880fa972 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:49.949205 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0a4aae6d-e054-45d6-bbef-c0df880fa972 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:50.050817 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-0a4aae6d-e054-45d6-bbef-c0df880fa972 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "POST /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d/action" status: 200 len: 38260 microversion: 2.20 time: 0.119181 Feb 17 04:42:50.051529 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 397/793] 10.222.0.38 () {62 vars in 1309 bytes} [Wed Feb 17 04:42:49 2021] POST /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d/action => generated 38260 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:42:50.425552 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-0b95d4ac-18c6-4ea2-a7d0-128ce95b09cb tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:50.426276 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-0b95d4ac-18c6-4ea2-a7d0-128ce95b09cb tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] [instance: 2d5996f2-39d5-43b5-878f-920d0b4401b9] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:50.434480 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0b95d4ac-18c6-4ea2-a7d0-128ce95b09cb tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:50.435024 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0b95d4ac-18c6-4ea2-a7d0-128ce95b09cb tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:50.435863 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0b95d4ac-18c6-4ea2-a7d0-128ce95b09cb tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:50.436562 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0b95d4ac-18c6-4ea2-a7d0-128ce95b09cb tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:50.647987 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-0b95d4ac-18c6-4ea2-a7d0-128ce95b09cb tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e476d21764ecfaf94b5f9a9d25b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b5af96686e409cb77e5a0aa9ac1fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:50.657822 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-0b95d4ac-18c6-4ea2-a7d0-128ce95b09cb tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] 10.222.0.38 "GET /compute/v2.1/servers/2d5996f2-39d5-43b5-878f-920d0b4401b9" status: 200 len: 1496 microversion: 2.1 time: 0.236301 Feb 17 04:42:50.658423 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 397/794] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:42:50 2021] GET /compute/v2.1/servers/2d5996f2-39d5-43b5-878f-920d0b4401b9 => generated 1496 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:42:51.065482 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-fc323c79-6649-4788-9596-a2f2322f5cdc tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:42:51.066731 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-fc323c79-6649-4788-9596-a2f2322f5cdc tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:51.075265 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-fc323c79-6649-4788-9596-a2f2322f5cdc tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:51.075785 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-fc323c79-6649-4788-9596-a2f2322f5cdc tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:51.076710 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-fc323c79-6649-4788-9596-a2f2322f5cdc tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:51.077840 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-fc323c79-6649-4788-9596-a2f2322f5cdc tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:51.195620 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-fc323c79-6649-4788-9596-a2f2322f5cdc tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "POST /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d/action" status: 200 len: 38403 microversion: 2.20 time: 0.135284 Feb 17 04:42:51.196327 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 398/795] 10.222.0.38 () {62 vars in 1309 bytes} [Wed Feb 17 04:42:51 2021] POST /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d/action => generated 38403 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:42:51.207487 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-aa5eafd1-5d77-4d2d-8d19-791593910e0e tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:51.208145 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-aa5eafd1-5d77-4d2d-8d19-791593910e0e tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:51.216562 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-aa5eafd1-5d77-4d2d-8d19-791593910e0e tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:51.217074 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-aa5eafd1-5d77-4d2d-8d19-791593910e0e tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:51.218399 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-aa5eafd1-5d77-4d2d-8d19-791593910e0e tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:51.218923 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-aa5eafd1-5d77-4d2d-8d19-791593910e0e tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:51.284339 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-aa5eafd1-5d77-4d2d-8d19-791593910e0e tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d/ips" status: 200 len: 150 microversion: 2.20 time: 0.080259 Feb 17 04:42:51.284461 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 398/796] 10.222.0.38 () {60 vars in 1279 bytes} [Wed Feb 17 04:42:51 2021] GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d/ips => generated 150 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:42:51.475601 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-dce62f12-62e3-4b58-9883-c1d33f037e76 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:51.476261 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-dce62f12-62e3-4b58-9883-c1d33f037e76 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] [instance: 2d5996f2-39d5-43b5-878f-920d0b4401b9] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:51.484789 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-dce62f12-62e3-4b58-9883-c1d33f037e76 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:51.485297 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-dce62f12-62e3-4b58-9883-c1d33f037e76 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:51.486146 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-dce62f12-62e3-4b58-9883-c1d33f037e76 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:51.486705 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-dce62f12-62e3-4b58-9883-c1d33f037e76 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:51.551696 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-dce62f12-62e3-4b58-9883-c1d33f037e76 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] [instance: 2d5996f2-39d5-43b5-878f-920d0b4401b9] Going to try to terminate instance {{(pid=98080) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 04:42:51.681707 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-dce62f12-62e3-4b58-9883-c1d33f037e76 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] 10.222.0.38 "DELETE /compute/v2.1/servers/2d5996f2-39d5-43b5-878f-920d0b4401b9" status: 204 len: 0 microversion: 2.1 time: 0.209845 Feb 17 04:42:51.682915 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 399/797] 10.222.0.38 () {58 vars in 1229 bytes} [Wed Feb 17 04:42:51 2021] DELETE /compute/v2.1/servers/2d5996f2-39d5-43b5-878f-920d0b4401b9 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 17 04:42:51.692079 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-abb82592-c73b-4eea-93dd-9a7e9bf09de7 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:51.693081 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-abb82592-c73b-4eea-93dd-9a7e9bf09de7 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] [instance: 2d5996f2-39d5-43b5-878f-920d0b4401b9] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:51.701963 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-abb82592-c73b-4eea-93dd-9a7e9bf09de7 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:51.702617 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-abb82592-c73b-4eea-93dd-9a7e9bf09de7 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:51.704124 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-abb82592-c73b-4eea-93dd-9a7e9bf09de7 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:51.704691 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-abb82592-c73b-4eea-93dd-9a7e9bf09de7 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:51.922981 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-abb82592-c73b-4eea-93dd-9a7e9bf09de7 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e476d21764ecfaf94b5f9a9d25b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b5af96686e409cb77e5a0aa9ac1fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:51.931968 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-abb82592-c73b-4eea-93dd-9a7e9bf09de7 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] 10.222.0.38 "GET /compute/v2.1/servers/2d5996f2-39d5-43b5-878f-920d0b4401b9" status: 200 len: 1502 microversion: 2.1 time: 0.243946 Feb 17 04:42:51.932512 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 399/798] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:42:51 2021] GET /compute/v2.1/servers/2d5996f2-39d5-43b5-878f-920d0b4401b9 => generated 1502 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:42:52.486683 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-e79da6cf-04c2-4ef5-bec5-4c750fc2a0c5 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-238713999", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1943374732", "security_groups": [{"name": "tempest-TestShelveInstance-645413079"}], "networks": [{"uuid": "3468340d-819b-4c91-9b3c-03f43d53a90d"}], "block_device_mapping_v2": [{"uuid": "aeaffa4b-904f-4612-bfca-25c229855682", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:42:52.670352 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.network.neutron [None req-e79da6cf-04c2-4ef5-bec5-4c750fc2a0c5 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] validate_networks() for [('3468340d-819b-4c91-9b3c-03f43d53a90d', None, None, None)] {{(pid=98080) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 04:42:52.951303 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-3089f685-f929-4e15-ae34-190b5a794307 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:52.952091 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-3089f685-f929-4e15-ae34-190b5a794307 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] [instance: 2d5996f2-39d5-43b5-878f-920d0b4401b9] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:52.959978 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-3089f685-f929-4e15-ae34-190b5a794307 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:52.960494 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-3089f685-f929-4e15-ae34-190b5a794307 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:52.961352 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-3089f685-f929-4e15-ae34-190b5a794307 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:52.961853 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-3089f685-f929-4e15-ae34-190b5a794307 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:53.492639 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-3089f685-f929-4e15-ae34-190b5a794307 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e476d21764ecfaf94b5f9a9d25b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b5af96686e409cb77e5a0aa9ac1fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:53.502275 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-3089f685-f929-4e15-ae34-190b5a794307 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] 10.222.0.38 "GET /compute/v2.1/servers/2d5996f2-39d5-43b5-878f-920d0b4401b9" status: 200 len: 1502 microversion: 2.1 time: 0.554913 Feb 17 04:42:53.502934 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 400/799] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:42:52 2021] GET /compute/v2.1/servers/2d5996f2-39d5-43b5-878f-920d0b4401b9 => generated 1502 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:42:53.569966 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-e79da6cf-04c2-4ef5-bec5-4c750fc2a0c5 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Flavor limits 0:0:0 {{(pid=98080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 04:42:53.570447 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-e79da6cf-04c2-4ef5-bec5-4c750fc2a0c5 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Image limits 0:0:0 {{(pid=98080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 04:42:53.571043 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-e79da6cf-04c2-4ef5-bec5-4c750fc2a0c5 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Flavor pref 0:0:0 {{(pid=98080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 04:42:53.571506 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-e79da6cf-04c2-4ef5-bec5-4c750fc2a0c5 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Image pref 0:0:0 {{(pid=98080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 04:42:53.571972 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-e79da6cf-04c2-4ef5-bec5-4c750fc2a0c5 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 04:42:53.581159 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e79da6cf-04c2-4ef5-bec5-4c750fc2a0c5 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:53.581668 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e79da6cf-04c2-4ef5-bec5-4c750fc2a0c5 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:53.582541 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e79da6cf-04c2-4ef5-bec5-4c750fc2a0c5 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:53.583060 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e79da6cf-04c2-4ef5-bec5-4c750fc2a0c5 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:53.605172 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.quota [None req-e79da6cf-04c2-4ef5-bec5-4c750fc2a0c5 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Getting quotas for project ca59cfbe7f3b494499cc8efe1d0e093e. Resources: {'instances', 'cores', 'ram'} {{(pid=98080) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:42:53.610249 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.quota [None req-e79da6cf-04c2-4ef5-bec5-4c750fc2a0c5 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Getting quotas for user 82cd0aa08bfc4637a988f25eec8cfb41 and project ca59cfbe7f3b494499cc8efe1d0e093e. Resources: {'instances', 'cores', 'ram'} {{(pid=98080) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:42:53.724742 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-e79da6cf-04c2-4ef5-bec5-4c750fc2a0c5 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Going to run 1 instances... {{(pid=98080) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 04:42:53.727510 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-e79da6cf-04c2-4ef5-bec5-4c750fc2a0c5 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] [instance: e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='aeaffa4b-904f-4612-bfca-25c229855682',volume_size=None,volume_type=None)] {{(pid=98080) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 04:42:53.747657 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [req-888c7b56-20ad-4aed-8d99-5f736111eedd req-f2d6b8cf-800b-41db-9b5b-2317690fe9a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d5996f2-39d5-43b5-878f-920d0b4401b9", "name": "network-vif-unplugged", "status": "completed", "tag": "be972db2-4143-4b74-9ace-aed5ef844f2b"}]} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:42:53.750718 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:42:53.750718 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:42:53.767571 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-888c7b56-20ad-4aed-8d99-5f736111eedd req-f2d6b8cf-800b-41db-9b5b-2317690fe9a1 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:53.768201 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-888c7b56-20ad-4aed-8d99-5f736111eedd req-f2d6b8cf-800b-41db-9b5b-2317690fe9a1 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:53.790513 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.compute.server_external_events [req-888c7b56-20ad-4aed-8d99-5f736111eedd req-f2d6b8cf-800b-41db-9b5b-2317690fe9a1 service nova] Creating event network-vif-unplugged:be972db2-4143-4b74-9ace-aed5ef844f2b for instance 2d5996f2-39d5-43b5-878f-920d0b4401b9 on hv-cinder-76019 Feb 17 04:42:53.799954 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [req-888c7b56-20ad-4aed-8d99-5f736111eedd req-f2d6b8cf-800b-41db-9b5b-2317690fe9a1 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057073 Feb 17 04:42:53.800626 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 401/800] 10.222.0.38 () {64 vars in 1308 bytes} [Wed Feb 17 04:42:53 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:42:53.917919 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-e79da6cf-04c2-4ef5-bec5-4c750fc2a0c5 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] 10.222.0.38 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.436508 Feb 17 04:42:53.918673 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 400/801] 10.222.0.38 () {60 vars in 1137 bytes} [Wed Feb 17 04:42:52 2021] POST /compute/v2.1/servers => generated 409 bytes in 1438 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 17 04:42:53.930671 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-befb1be7-4b8f-4835-87bf-2cd226b0712a tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:53.931443 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-befb1be7-4b8f-4835-87bf-2cd226b0712a tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] [instance: e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:53.968734 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-0176309f-0163-4d77-a428-0cf7640056e4 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:42:53.971292 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-0176309f-0163-4d77-a428-0cf7640056e4 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:53.981513 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0176309f-0163-4d77-a428-0cf7640056e4 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:53.982153 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0176309f-0163-4d77-a428-0cf7640056e4 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:53.983726 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0176309f-0163-4d77-a428-0cf7640056e4 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:53.984222 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0176309f-0163-4d77-a428-0cf7640056e4 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:54.044919 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.objects.instance [None req-0176309f-0163-4d77-a428-0cf7640056e4 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lazy-loading 'flavor' on Instance uuid 65811bec-2a80-4c2b-a424-f2a986a6055d {{(pid=98080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:42:54.047691 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-befb1be7-4b8f-4835-87bf-2cd226b0712a tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cd0aa08bfc4637a988f25eec8cfb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca59cfbe7f3b494499cc8efe1d0e093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:54.057238 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-befb1be7-4b8f-4835-87bf-2cd226b0712a tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] 10.222.0.38 "GET /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2" status: 200 len: 1088 microversion: 2.1 time: 0.130984 Feb 17 04:42:54.058435 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 402/802] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:42:53 2021] GET /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2 => generated 1088 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:42:54.404462 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-0176309f-0163-4d77-a428-0cf7640056e4 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "POST /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d/action" status: 202 len: 0 microversion: 2.20 time: 0.440716 Feb 17 04:42:54.405343 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 401/803] 10.222.0.38 () {62 vars in 1309 bytes} [Wed Feb 17 04:42:53 2021] POST /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d/action => generated 0 bytes in 443 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 17 04:42:54.415510 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-5bfa762f-5cfa-4a57-965a-5876e813f51f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:54.416217 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-5bfa762f-5cfa-4a57-965a-5876e813f51f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:54.434891 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5bfa762f-5cfa-4a57-965a-5876e813f51f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:54.436445 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5bfa762f-5cfa-4a57-965a-5876e813f51f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:54.437313 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5bfa762f-5cfa-4a57-965a-5876e813f51f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:54.437809 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5bfa762f-5cfa-4a57-965a-5876e813f51f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:54.521753 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-45505f06-c47e-42a8-87b1-96605e497f01 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:54.522593 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-45505f06-c47e-42a8-87b1-96605e497f01 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] [instance: 2d5996f2-39d5-43b5-878f-920d0b4401b9] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:54.532814 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-45505f06-c47e-42a8-87b1-96605e497f01 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:54.533326 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-45505f06-c47e-42a8-87b1-96605e497f01 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:54.534174 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-45505f06-c47e-42a8-87b1-96605e497f01 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:54.534702 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-45505f06-c47e-42a8-87b1-96605e497f01 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:54.849971 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-5bfa762f-5cfa-4a57-965a-5876e813f51f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:54.859491 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-5bfa762f-5cfa-4a57-965a-5876e813f51f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:54.861103 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-5bfa762f-5cfa-4a57-965a-5876e813f51f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:54.862309 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-5bfa762f-5cfa-4a57-965a-5876e813f51f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d" status: 200 len: 1722 microversion: 2.20 time: 0.450904 Feb 17 04:42:54.862974 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 403/804] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:42:54 2021] GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d => generated 1722 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:42:55.076995 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-4d5afc91-e3ff-491f-8502-67472b710c5f tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:55.077863 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-4d5afc91-e3ff-491f-8502-67472b710c5f tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] [instance: e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:55.085811 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4d5afc91-e3ff-491f-8502-67472b710c5f tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:55.086343 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4d5afc91-e3ff-491f-8502-67472b710c5f tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:55.087311 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4d5afc91-e3ff-491f-8502-67472b710c5f tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:55.087887 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4d5afc91-e3ff-491f-8502-67472b710c5f tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:55.128628 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-45505f06-c47e-42a8-87b1-96605e497f01 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e476d21764ecfaf94b5f9a9d25b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b5af96686e409cb77e5a0aa9ac1fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:55.139431 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-45505f06-c47e-42a8-87b1-96605e497f01 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] 10.222.0.38 "GET /compute/v2.1/servers/2d5996f2-39d5-43b5-878f-920d0b4401b9" status: 200 len: 1502 microversion: 2.1 time: 0.622351 Feb 17 04:42:55.148107 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 402/805] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:42:54 2021] GET /compute/v2.1/servers/2d5996f2-39d5-43b5-878f-920d0b4401b9 => generated 1502 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:42:55.363366 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-4d5afc91-e3ff-491f-8502-67472b710c5f tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cd0aa08bfc4637a988f25eec8cfb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca59cfbe7f3b494499cc8efe1d0e093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:55.373027 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-4d5afc91-e3ff-491f-8502-67472b710c5f tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] 10.222.0.38 "GET /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2" status: 200 len: 1204 microversion: 2.1 time: 0.299979 Feb 17 04:42:55.374344 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 404/806] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:42:55 2021] GET /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2 => generated 1204 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:42:55.881727 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-fe82152d-9463-4511-bd06-e3b6ce78abd4 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:55.882399 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-fe82152d-9463-4511-bd06-e3b6ce78abd4 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:55.891348 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-fe82152d-9463-4511-bd06-e3b6ce78abd4 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:55.891861 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-fe82152d-9463-4511-bd06-e3b6ce78abd4 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:55.892712 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-fe82152d-9463-4511-bd06-e3b6ce78abd4 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:55.893211 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-fe82152d-9463-4511-bd06-e3b6ce78abd4 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:56.158350 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-60a32400-a3d9-4be8-8f25-a6b43da11267 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:56.159181 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-60a32400-a3d9-4be8-8f25-a6b43da11267 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] [instance: 2d5996f2-39d5-43b5-878f-920d0b4401b9] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:56.167030 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-60a32400-a3d9-4be8-8f25-a6b43da11267 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:56.167537 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-60a32400-a3d9-4be8-8f25-a6b43da11267 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:56.168376 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-60a32400-a3d9-4be8-8f25-a6b43da11267 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:56.168865 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-60a32400-a3d9-4be8-8f25-a6b43da11267 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:56.353452 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-60a32400-a3d9-4be8-8f25-a6b43da11267 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e26e476d21764ecfaf94b5f9a9d25b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b5af96686e409cb77e5a0aa9ac1fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:56.363048 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-60a32400-a3d9-4be8-8f25-a6b43da11267 tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] 10.222.0.38 "GET /compute/v2.1/servers/2d5996f2-39d5-43b5-878f-920d0b4401b9" status: 200 len: 1460 microversion: 2.1 time: 0.209352 Feb 17 04:42:56.363667 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 405/807] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:42:56 2021] GET /compute/v2.1/servers/2d5996f2-39d5-43b5-878f-920d0b4401b9 => generated 1460 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:42:56.368459 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [req-c334c67a-6715-4ed5-8e3d-b48c7c376efe req-c2de20af-8ca0-41e2-969e-d33117f4747f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d5996f2-39d5-43b5-878f-920d0b4401b9", "name": "network-vif-deleted", "tag": "be972db2-4143-4b74-9ace-aed5ef844f2b"}]} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:42:56.370098 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:42:56.370098 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:42:56.379264 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-c334c67a-6715-4ed5-8e3d-b48c7c376efe req-c2de20af-8ca0-41e2-969e-d33117f4747f service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:56.379774 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-c334c67a-6715-4ed5-8e3d-b48c7c376efe req-c2de20af-8ca0-41e2-969e-d33117f4747f service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:56.403051 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.compute.server_external_events [req-c334c67a-6715-4ed5-8e3d-b48c7c376efe req-c2de20af-8ca0-41e2-969e-d33117f4747f service nova] Creating event network-vif-deleted:be972db2-4143-4b74-9ace-aed5ef844f2b for instance 2d5996f2-39d5-43b5-878f-920d0b4401b9 on hv-cinder-76019 Feb 17 04:42:56.409151 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [req-c334c67a-6715-4ed5-8e3d-b48c7c376efe req-c2de20af-8ca0-41e2-969e-d33117f4747f service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044157 Feb 17 04:42:56.410113 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 406/808] 10.222.0.38 () {64 vars in 1308 bytes} [Wed Feb 17 04:42:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:42:56.416551 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-efb7af12-d34b-42d5-844c-b06cac1e3e81 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:56.417524 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-efb7af12-d34b-42d5-844c-b06cac1e3e81 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] [instance: e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:56.426626 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-efb7af12-d34b-42d5-844c-b06cac1e3e81 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:56.427152 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-efb7af12-d34b-42d5-844c-b06cac1e3e81 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:56.428469 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-efb7af12-d34b-42d5-844c-b06cac1e3e81 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:56.428983 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-efb7af12-d34b-42d5-844c-b06cac1e3e81 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:56.453377 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-fe82152d-9463-4511-bd06-e3b6ce78abd4 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:56.469168 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-fe82152d-9463-4511-bd06-e3b6ce78abd4 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:56.471215 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-fe82152d-9463-4511-bd06-e3b6ce78abd4 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:56.473482 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-fe82152d-9463-4511-bd06-e3b6ce78abd4 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d" status: 200 len: 1722 microversion: 2.20 time: 0.595999 Feb 17 04:42:56.474691 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 403/809] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:42:55 2021] GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d => generated 1722 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:42:56.596901 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-efb7af12-d34b-42d5-844c-b06cac1e3e81 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cd0aa08bfc4637a988f25eec8cfb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca59cfbe7f3b494499cc8efe1d0e093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:56.606034 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-efb7af12-d34b-42d5-844c-b06cac1e3e81 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] 10.222.0.38 "GET /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2" status: 200 len: 1192 microversion: 2.1 time: 0.194658 Feb 17 04:42:56.606669 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 407/810] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:42:56 2021] GET /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2 => generated 1192 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:42:57.381685 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-41c34025-06d2-4d70-a0d0-eadfae067e7e tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:57.383012 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-41c34025-06d2-4d70-a0d0-eadfae067e7e tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] [instance: 2d5996f2-39d5-43b5-878f-920d0b4401b9] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:57.391551 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-41c34025-06d2-4d70-a0d0-eadfae067e7e tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:57.392062 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-41c34025-06d2-4d70-a0d0-eadfae067e7e tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:57.392913 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-41c34025-06d2-4d70-a0d0-eadfae067e7e tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:57.393383 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-41c34025-06d2-4d70-a0d0-eadfae067e7e tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:57.448285 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.wsgi [None req-41c34025-06d2-4d70-a0d0-eadfae067e7e tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] HTTP exception thrown: Instance 2d5996f2-39d5-43b5-878f-920d0b4401b9 could not be found. Feb 17 04:42:57.448960 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-41c34025-06d2-4d70-a0d0-eadfae067e7e tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] Returning 404 to user: Instance 2d5996f2-39d5-43b5-878f-920d0b4401b9 could not be found. {{(pid=98080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:42:57.449871 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-41c34025-06d2-4d70-a0d0-eadfae067e7e tempest-VolumesActionsTest-1240869276 tempest-VolumesActionsTest-1240869276-project] 10.222.0.38 "GET /compute/v2.1/servers/2d5996f2-39d5-43b5-878f-920d0b4401b9" status: 404 len: 111 microversion: 2.1 time: 0.072488 Feb 17 04:42:57.450477 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 404/811] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:42:57 2021] GET /compute/v2.1/servers/2d5996f2-39d5-43b5-878f-920d0b4401b9 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:42:57.493691 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-99f3c9ee-cf72-4b06-a048-fcbe071676e2 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:57.494583 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-99f3c9ee-cf72-4b06-a048-fcbe071676e2 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:57.503124 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-99f3c9ee-cf72-4b06-a048-fcbe071676e2 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:57.503869 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-99f3c9ee-cf72-4b06-a048-fcbe071676e2 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:57.504872 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-99f3c9ee-cf72-4b06-a048-fcbe071676e2 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:57.505512 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-99f3c9ee-cf72-4b06-a048-fcbe071676e2 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:57.625359 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-cf836371-ac16-451c-b89a-b219b9e6a9ae tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:57.626350 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-cf836371-ac16-451c-b89a-b219b9e6a9ae tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] [instance: e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:57.634543 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-cf836371-ac16-451c-b89a-b219b9e6a9ae tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:57.635363 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-cf836371-ac16-451c-b89a-b219b9e6a9ae tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:57.636310 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-cf836371-ac16-451c-b89a-b219b9e6a9ae tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:57.636903 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-cf836371-ac16-451c-b89a-b219b9e6a9ae tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:58.002624 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-99f3c9ee-cf72-4b06-a048-fcbe071676e2 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:58.012841 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-99f3c9ee-cf72-4b06-a048-fcbe071676e2 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:58.015333 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-99f3c9ee-cf72-4b06-a048-fcbe071676e2 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:58.016863 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-99f3c9ee-cf72-4b06-a048-fcbe071676e2 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d" status: 200 len: 1722 microversion: 2.20 time: 0.527043 Feb 17 04:42:58.017532 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 408/812] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:42:57 2021] GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d => generated 1722 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:42:58.175480 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-cf836371-ac16-451c-b89a-b219b9e6a9ae tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cd0aa08bfc4637a988f25eec8cfb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca59cfbe7f3b494499cc8efe1d0e093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:58.184928 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-cf836371-ac16-451c-b89a-b219b9e6a9ae tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] 10.222.0.38 "GET /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2" status: 200 len: 1263 microversion: 2.1 time: 0.563559 Feb 17 04:42:58.185701 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 405/813] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:42:57 2021] GET /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2 => generated 1263 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:42:59.037270 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-64ea3200-d439-46d8-9f7d-1b0c8fc259da tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:59.038045 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-64ea3200-d439-46d8-9f7d-1b0c8fc259da tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:59.046696 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-64ea3200-d439-46d8-9f7d-1b0c8fc259da tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:59.047209 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-64ea3200-d439-46d8-9f7d-1b0c8fc259da tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:59.048057 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-64ea3200-d439-46d8-9f7d-1b0c8fc259da tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:59.048551 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-64ea3200-d439-46d8-9f7d-1b0c8fc259da tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:59.134921 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [req-7f8e6925-039f-40af-b2bd-b8c0dda84fa6 req-1cbdb307-0f44-4f11-97de-ea2930d12123 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2", "tag": "6738a807-1bee-443c-9281-dcce36604367"}]} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:42:59.136731 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:42:59.136731 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:42:59.146682 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-7f8e6925-039f-40af-b2bd-b8c0dda84fa6 req-1cbdb307-0f44-4f11-97de-ea2930d12123 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:59.147193 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-7f8e6925-039f-40af-b2bd-b8c0dda84fa6 req-1cbdb307-0f44-4f11-97de-ea2930d12123 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:59.166740 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.compute.server_external_events [req-7f8e6925-039f-40af-b2bd-b8c0dda84fa6 req-1cbdb307-0f44-4f11-97de-ea2930d12123 service nova] Creating event network-changed:6738a807-1bee-443c-9281-dcce36604367 for instance e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2 on hv-cinder-76019 Feb 17 04:42:59.172755 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [req-7f8e6925-039f-40af-b2bd-b8c0dda84fa6 req-1cbdb307-0f44-4f11-97de-ea2930d12123 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041816 Feb 17 04:42:59.173673 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 406/814] 10.222.0.38 () {64 vars in 1308 bytes} [Wed Feb 17 04:42:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:42:59.204561 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-cf26eec9-6d8c-4b9f-9a02-d060e0b13db4 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:42:59.205332 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-cf26eec9-6d8c-4b9f-9a02-d060e0b13db4 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] [instance: e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:42:59.214546 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-cf26eec9-6d8c-4b9f-9a02-d060e0b13db4 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:59.215087 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-cf26eec9-6d8c-4b9f-9a02-d060e0b13db4 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:59.215940 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-cf26eec9-6d8c-4b9f-9a02-d060e0b13db4 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:42:59.216432 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-cf26eec9-6d8c-4b9f-9a02-d060e0b13db4 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:42:59.277309 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-64ea3200-d439-46d8-9f7d-1b0c8fc259da tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:59.296048 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-64ea3200-d439-46d8-9f7d-1b0c8fc259da tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:59.297694 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-64ea3200-d439-46d8-9f7d-1b0c8fc259da tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:59.298919 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-64ea3200-d439-46d8-9f7d-1b0c8fc259da tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d" status: 200 len: 1722 microversion: 2.20 time: 0.265780 Feb 17 04:42:59.299521 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 409/815] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:42:59 2021] GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d => generated 1722 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:42:59.440431 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-cf26eec9-6d8c-4b9f-9a02-d060e0b13db4 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cd0aa08bfc4637a988f25eec8cfb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca59cfbe7f3b494499cc8efe1d0e093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:42:59.449096 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-cf26eec9-6d8c-4b9f-9a02-d060e0b13db4 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] 10.222.0.38 "GET /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2" status: 200 len: 1263 microversion: 2.1 time: 0.249221 Feb 17 04:42:59.449695 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 407/816] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:42:59 2021] GET /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2 => generated 1263 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:43:00.319463 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-bc7dffcc-5719-4198-87f0-dc531c5fbf03 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:43:00.320070 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-bc7dffcc-5719-4198-87f0-dc531c5fbf03 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:43:00.328241 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-bc7dffcc-5719-4198-87f0-dc531c5fbf03 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:00.328756 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-bc7dffcc-5719-4198-87f0-dc531c5fbf03 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:00.329609 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-bc7dffcc-5719-4198-87f0-dc531c5fbf03 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:00.330112 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-bc7dffcc-5719-4198-87f0-dc531c5fbf03 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:00.469031 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-4baa9e14-a9e4-4b06-b567-f4301015da4c tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:43:00.469885 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-4baa9e14-a9e4-4b06-b567-f4301015da4c tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] [instance: e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:43:00.477881 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4baa9e14-a9e4-4b06-b567-f4301015da4c tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:00.478391 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4baa9e14-a9e4-4b06-b567-f4301015da4c tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:00.479266 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4baa9e14-a9e4-4b06-b567-f4301015da4c tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:00.479925 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4baa9e14-a9e4-4b06-b567-f4301015da4c tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:00.546802 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-bc7dffcc-5719-4198-87f0-dc531c5fbf03 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:00.557215 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-bc7dffcc-5719-4198-87f0-dc531c5fbf03 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:00.559080 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-bc7dffcc-5719-4198-87f0-dc531c5fbf03 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:00.560287 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-bc7dffcc-5719-4198-87f0-dc531c5fbf03 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d" status: 200 len: 1722 microversion: 2.20 time: 0.245055 Feb 17 04:43:00.561437 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 410/817] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:43:00 2021] GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d => generated 1722 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:43:00.693692 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-4baa9e14-a9e4-4b06-b567-f4301015da4c tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cd0aa08bfc4637a988f25eec8cfb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca59cfbe7f3b494499cc8efe1d0e093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:00.703127 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-4baa9e14-a9e4-4b06-b567-f4301015da4c tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] 10.222.0.38 "GET /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2" status: 200 len: 1263 microversion: 2.1 time: 0.239439 Feb 17 04:43:00.703730 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 408/818] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:43:00 2021] GET /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2 => generated 1263 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:43:01.581048 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-6a922e38-5d68-4870-afe2-1ee6d8f09476 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:43:01.581768 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-6a922e38-5d68-4870-afe2-1ee6d8f09476 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:43:01.589634 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6a922e38-5d68-4870-afe2-1ee6d8f09476 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:01.590146 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6a922e38-5d68-4870-afe2-1ee6d8f09476 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:01.591009 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6a922e38-5d68-4870-afe2-1ee6d8f09476 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:01.591506 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6a922e38-5d68-4870-afe2-1ee6d8f09476 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:01.722413 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-2a8f3679-23c6-4c83-974f-202c5670f2db tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:43:01.723420 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-2a8f3679-23c6-4c83-974f-202c5670f2db tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] [instance: e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:43:01.731463 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2a8f3679-23c6-4c83-974f-202c5670f2db tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:01.731964 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2a8f3679-23c6-4c83-974f-202c5670f2db tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:01.732848 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2a8f3679-23c6-4c83-974f-202c5670f2db tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:01.733524 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2a8f3679-23c6-4c83-974f-202c5670f2db tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:01.930910 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-6a922e38-5d68-4870-afe2-1ee6d8f09476 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:01.941105 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-6a922e38-5d68-4870-afe2-1ee6d8f09476 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:01.942733 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-6a922e38-5d68-4870-afe2-1ee6d8f09476 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:01.943912 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-6a922e38-5d68-4870-afe2-1ee6d8f09476 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d" status: 200 len: 1722 microversion: 2.20 time: 0.367455 Feb 17 04:43:01.944534 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 411/819] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:43:01 2021] GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d => generated 1722 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:43:02.132916 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-2a8f3679-23c6-4c83-974f-202c5670f2db tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cd0aa08bfc4637a988f25eec8cfb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca59cfbe7f3b494499cc8efe1d0e093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:02.141874 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-2a8f3679-23c6-4c83-974f-202c5670f2db tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] 10.222.0.38 "GET /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2" status: 200 len: 1263 microversion: 2.1 time: 0.424785 Feb 17 04:43:02.142713 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 409/820] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:43:01 2021] GET /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2 => generated 1263 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:43:02.969719 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-f68d4073-3f84-439f-845f-9919ee5e83c8 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:43:02.970555 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-f68d4073-3f84-439f-845f-9919ee5e83c8 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:43:02.983070 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f68d4073-3f84-439f-845f-9919ee5e83c8 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:02.983866 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f68d4073-3f84-439f-845f-9919ee5e83c8 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:02.984821 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f68d4073-3f84-439f-845f-9919ee5e83c8 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:02.985507 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f68d4073-3f84-439f-845f-9919ee5e83c8 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:03.164657 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-41979afb-43fb-4354-a242-d45114aeb4bf tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:43:03.165973 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-41979afb-43fb-4354-a242-d45114aeb4bf tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] [instance: e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:43:03.179708 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-41979afb-43fb-4354-a242-d45114aeb4bf tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:03.181026 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-41979afb-43fb-4354-a242-d45114aeb4bf tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:03.190076 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-41979afb-43fb-4354-a242-d45114aeb4bf tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:03.190618 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-41979afb-43fb-4354-a242-d45114aeb4bf tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:03.245232 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-f68d4073-3f84-439f-845f-9919ee5e83c8 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:03.257622 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-f68d4073-3f84-439f-845f-9919ee5e83c8 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:03.260011 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-f68d4073-3f84-439f-845f-9919ee5e83c8 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:03.261579 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-f68d4073-3f84-439f-845f-9919ee5e83c8 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d" status: 200 len: 1722 microversion: 2.20 time: 0.299268 Feb 17 04:43:03.262896 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 412/821] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:43:02 2021] GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d => generated 1722 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:43:03.484907 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-41979afb-43fb-4354-a242-d45114aeb4bf tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cd0aa08bfc4637a988f25eec8cfb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca59cfbe7f3b494499cc8efe1d0e093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:03.496621 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-41979afb-43fb-4354-a242-d45114aeb4bf tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] 10.222.0.38 "GET /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2" status: 200 len: 1263 microversion: 2.1 time: 0.339109 Feb 17 04:43:03.497302 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 410/822] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:43:03 2021] GET /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2 => generated 1263 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:43:04.283710 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-4b21ae27-70fe-4172-abec-8b7362fc1e5f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:43:04.284414 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-4b21ae27-70fe-4172-abec-8b7362fc1e5f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:43:04.292604 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4b21ae27-70fe-4172-abec-8b7362fc1e5f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:04.295438 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4b21ae27-70fe-4172-abec-8b7362fc1e5f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:04.296005 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4b21ae27-70fe-4172-abec-8b7362fc1e5f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:04.296525 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4b21ae27-70fe-4172-abec-8b7362fc1e5f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:04.516466 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-5fc3e1a6-d313-474c-90df-e2d31a0fef6f tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:43:04.517662 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-5fc3e1a6-d313-474c-90df-e2d31a0fef6f tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] [instance: e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:43:04.526954 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5fc3e1a6-d313-474c-90df-e2d31a0fef6f tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:04.527845 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5fc3e1a6-d313-474c-90df-e2d31a0fef6f tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:04.529471 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5fc3e1a6-d313-474c-90df-e2d31a0fef6f tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:04.530480 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5fc3e1a6-d313-474c-90df-e2d31a0fef6f tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:04.539877 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-4b21ae27-70fe-4172-abec-8b7362fc1e5f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:04.555251 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-4b21ae27-70fe-4172-abec-8b7362fc1e5f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:04.557558 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-4b21ae27-70fe-4172-abec-8b7362fc1e5f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:04.559982 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-4b21ae27-70fe-4172-abec-8b7362fc1e5f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d" status: 200 len: 1722 microversion: 2.20 time: 0.279332 Feb 17 04:43:04.561557 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 413/823] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:43:04 2021] GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d => generated 1722 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:43:04.770476 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-5fc3e1a6-d313-474c-90df-e2d31a0fef6f tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cd0aa08bfc4637a988f25eec8cfb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca59cfbe7f3b494499cc8efe1d0e093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:04.782281 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-5fc3e1a6-d313-474c-90df-e2d31a0fef6f tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] 10.222.0.38 "GET /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2" status: 200 len: 1263 microversion: 2.1 time: 0.270937 Feb 17 04:43:04.783318 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 411/824] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:43:04 2021] GET /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2 => generated 1263 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:43:05.580798 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-311e436a-7ed3-4340-b85d-9a742af3eac8 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:43:05.581533 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-311e436a-7ed3-4340-b85d-9a742af3eac8 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:43:05.589358 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-311e436a-7ed3-4340-b85d-9a742af3eac8 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:05.589867 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-311e436a-7ed3-4340-b85d-9a742af3eac8 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:05.590738 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-311e436a-7ed3-4340-b85d-9a742af3eac8 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:05.591230 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-311e436a-7ed3-4340-b85d-9a742af3eac8 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:05.802532 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-d146b645-86f0-493f-998d-4c5345b1f15f tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:43:05.803548 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-d146b645-86f0-493f-998d-4c5345b1f15f tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] [instance: e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:43:05.812467 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d146b645-86f0-493f-998d-4c5345b1f15f tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:05.813204 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d146b645-86f0-493f-998d-4c5345b1f15f tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:05.814207 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d146b645-86f0-493f-998d-4c5345b1f15f tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:05.814872 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d146b645-86f0-493f-998d-4c5345b1f15f tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:05.855314 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-311e436a-7ed3-4340-b85d-9a742af3eac8 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:05.865804 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-311e436a-7ed3-4340-b85d-9a742af3eac8 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:05.867969 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-311e436a-7ed3-4340-b85d-9a742af3eac8 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:05.869417 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-311e436a-7ed3-4340-b85d-9a742af3eac8 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d" status: 200 len: 1743 microversion: 2.20 time: 0.293331 Feb 17 04:43:05.870191 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 414/825] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:43:05 2021] GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d => generated 1743 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:43:06.075779 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-d146b645-86f0-493f-998d-4c5345b1f15f tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cd0aa08bfc4637a988f25eec8cfb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca59cfbe7f3b494499cc8efe1d0e093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:06.086051 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-d146b645-86f0-493f-998d-4c5345b1f15f tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] 10.222.0.38 "GET /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2" status: 200 len: 1263 microversion: 2.1 time: 0.289262 Feb 17 04:43:06.086849 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 412/826] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:43:05 2021] GET /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2 => generated 1263 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:43:06.891610 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-bd8de819-8585-40e1-a93f-c02e08d8a41a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:43:06.892400 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-bd8de819-8585-40e1-a93f-c02e08d8a41a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:43:06.900798 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-bd8de819-8585-40e1-a93f-c02e08d8a41a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:06.901575 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-bd8de819-8585-40e1-a93f-c02e08d8a41a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:06.902795 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-bd8de819-8585-40e1-a93f-c02e08d8a41a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:06.903540 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-bd8de819-8585-40e1-a93f-c02e08d8a41a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:07.104496 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-c658a794-ba9c-43ee-9239-d424b189cfd9 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:43:07.105172 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-c658a794-ba9c-43ee-9239-d424b189cfd9 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] [instance: e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:43:07.118087 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c658a794-ba9c-43ee-9239-d424b189cfd9 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:07.118637 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c658a794-ba9c-43ee-9239-d424b189cfd9 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:07.123048 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c658a794-ba9c-43ee-9239-d424b189cfd9 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:07.123759 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c658a794-ba9c-43ee-9239-d424b189cfd9 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:07.158744 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-bd8de819-8585-40e1-a93f-c02e08d8a41a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:07.178614 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-bd8de819-8585-40e1-a93f-c02e08d8a41a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:07.182518 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-bd8de819-8585-40e1-a93f-c02e08d8a41a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:07.185006 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-bd8de819-8585-40e1-a93f-c02e08d8a41a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d" status: 200 len: 1743 microversion: 2.20 time: 0.297889 Feb 17 04:43:07.186213 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 415/827] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:43:06 2021] GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d => generated 1743 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:43:07.392763 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-c658a794-ba9c-43ee-9239-d424b189cfd9 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cd0aa08bfc4637a988f25eec8cfb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca59cfbe7f3b494499cc8efe1d0e093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:07.403551 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-c658a794-ba9c-43ee-9239-d424b189cfd9 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] 10.222.0.38 "GET /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2" status: 200 len: 1263 microversion: 2.1 time: 0.302167 Feb 17 04:43:07.404550 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 413/828] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:43:07 2021] GET /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2 => generated 1263 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:43:08.207132 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-c1dbf6de-f9ac-4cba-89c4-ce6514d151bf tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:43:08.207743 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-c1dbf6de-f9ac-4cba-89c4-ce6514d151bf tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:43:08.240891 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c1dbf6de-f9ac-4cba-89c4-ce6514d151bf tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:08.241403 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c1dbf6de-f9ac-4cba-89c4-ce6514d151bf tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:08.242309 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c1dbf6de-f9ac-4cba-89c4-ce6514d151bf tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:08.242848 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c1dbf6de-f9ac-4cba-89c4-ce6514d151bf tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:08.429621 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-06489b91-92a3-49e3-aacb-b82a931e86ee tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:43:08.433118 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-06489b91-92a3-49e3-aacb-b82a931e86ee tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] [instance: e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:43:08.455142 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-06489b91-92a3-49e3-aacb-b82a931e86ee tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:08.458685 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-06489b91-92a3-49e3-aacb-b82a931e86ee tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:08.459774 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-06489b91-92a3-49e3-aacb-b82a931e86ee tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:08.461791 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-06489b91-92a3-49e3-aacb-b82a931e86ee tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:08.704786 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-c1dbf6de-f9ac-4cba-89c4-ce6514d151bf tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:08.750266 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-c1dbf6de-f9ac-4cba-89c4-ce6514d151bf tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:08.759221 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-c1dbf6de-f9ac-4cba-89c4-ce6514d151bf tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:08.781891 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-c1dbf6de-f9ac-4cba-89c4-ce6514d151bf tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d" status: 200 len: 1738 microversion: 2.20 time: 0.571973 Feb 17 04:43:08.782998 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 416/829] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:43:08 2021] GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d => generated 1738 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:43:09.001336 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-06489b91-92a3-49e3-aacb-b82a931e86ee tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cd0aa08bfc4637a988f25eec8cfb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca59cfbe7f3b494499cc8efe1d0e093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:09.020610 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-06489b91-92a3-49e3-aacb-b82a931e86ee tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] 10.222.0.38 "GET /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2" status: 200 len: 1263 microversion: 2.1 time: 0.596987 Feb 17 04:43:09.021950 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 414/830] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:43:08 2021] GET /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2 => generated 1263 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:43:09.817292 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-3699b17a-2af2-4e74-99ce-5a6ef3e2a87c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:43:09.820025 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-3699b17a-2af2-4e74-99ce-5a6ef3e2a87c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:43:09.837055 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-3699b17a-2af2-4e74-99ce-5a6ef3e2a87c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:09.837609 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-3699b17a-2af2-4e74-99ce-5a6ef3e2a87c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:09.838447 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-3699b17a-2af2-4e74-99ce-5a6ef3e2a87c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:09.839197 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-3699b17a-2af2-4e74-99ce-5a6ef3e2a87c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:10.040399 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-e38d97a6-9136-4e99-9306-a39266168c34 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:43:10.042625 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-e38d97a6-9136-4e99-9306-a39266168c34 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] [instance: e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:43:10.072819 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e38d97a6-9136-4e99-9306-a39266168c34 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:10.074028 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e38d97a6-9136-4e99-9306-a39266168c34 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:10.075160 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e38d97a6-9136-4e99-9306-a39266168c34 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:10.075849 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e38d97a6-9136-4e99-9306-a39266168c34 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:10.215773 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-3699b17a-2af2-4e74-99ce-5a6ef3e2a87c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:10.228289 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-3699b17a-2af2-4e74-99ce-5a6ef3e2a87c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:10.240879 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-3699b17a-2af2-4e74-99ce-5a6ef3e2a87c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:10.242608 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-3699b17a-2af2-4e74-99ce-5a6ef3e2a87c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d" status: 200 len: 1738 microversion: 2.20 time: 0.439185 Feb 17 04:43:10.255214 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 417/831] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:43:09 2021] GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d => generated 1738 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:43:10.511693 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-e38d97a6-9136-4e99-9306-a39266168c34 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cd0aa08bfc4637a988f25eec8cfb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca59cfbe7f3b494499cc8efe1d0e093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:10.531617 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-e38d97a6-9136-4e99-9306-a39266168c34 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] 10.222.0.38 "GET /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2" status: 200 len: 1263 microversion: 2.1 time: 0.495160 Feb 17 04:43:10.532685 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 415/832] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:43:10 2021] GET /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2 => generated 1263 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:43:11.274983 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-a71b5b49-ec4b-4ef3-b289-f3cc6bd7cb0a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:43:11.275759 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-a71b5b49-ec4b-4ef3-b289-f3cc6bd7cb0a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:43:11.285321 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a71b5b49-ec4b-4ef3-b289-f3cc6bd7cb0a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:11.285937 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a71b5b49-ec4b-4ef3-b289-f3cc6bd7cb0a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:11.286921 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a71b5b49-ec4b-4ef3-b289-f3cc6bd7cb0a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:11.287492 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a71b5b49-ec4b-4ef3-b289-f3cc6bd7cb0a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:11.557666 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-895fecb5-c36b-44c8-a011-23e361ba33ff tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:43:11.559032 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-895fecb5-c36b-44c8-a011-23e361ba33ff tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] [instance: e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:43:11.581993 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-895fecb5-c36b-44c8-a011-23e361ba33ff tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:11.589581 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-895fecb5-c36b-44c8-a011-23e361ba33ff tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:11.600285 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-895fecb5-c36b-44c8-a011-23e361ba33ff tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:11.601180 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-895fecb5-c36b-44c8-a011-23e361ba33ff tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:11.626014 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-a71b5b49-ec4b-4ef3-b289-f3cc6bd7cb0a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:11.639672 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-a71b5b49-ec4b-4ef3-b289-f3cc6bd7cb0a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:11.641469 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-a71b5b49-ec4b-4ef3-b289-f3cc6bd7cb0a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:11.642939 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-a71b5b49-ec4b-4ef3-b289-f3cc6bd7cb0a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d" status: 200 len: 1738 microversion: 2.20 time: 0.376624 Feb 17 04:43:11.643703 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 418/833] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:43:11 2021] GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d => generated 1738 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:43:11.861494 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [req-9d5edb66-cd65-4fad-9e10-a7ce4e3f04e8 req-c7518bf5-fe33-4a0f-81ed-4a8ab8445080 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2", "name": "network-vif-plugged", "status": "completed", "tag": "6738a807-1bee-443c-9281-dcce36604367"}]} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:43:11.863450 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:43:11.863450 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:43:11.882603 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-9d5edb66-cd65-4fad-9e10-a7ce4e3f04e8 req-c7518bf5-fe33-4a0f-81ed-4a8ab8445080 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:11.885636 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-9d5edb66-cd65-4fad-9e10-a7ce4e3f04e8 req-c7518bf5-fe33-4a0f-81ed-4a8ab8445080 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:11.924191 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.compute.server_external_events [req-9d5edb66-cd65-4fad-9e10-a7ce4e3f04e8 req-c7518bf5-fe33-4a0f-81ed-4a8ab8445080 service nova] Creating event network-vif-plugged:6738a807-1bee-443c-9281-dcce36604367 for instance e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2 on hv-cinder-76019 Feb 17 04:43:11.937312 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [req-9d5edb66-cd65-4fad-9e10-a7ce4e3f04e8 req-c7518bf5-fe33-4a0f-81ed-4a8ab8445080 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081242 Feb 17 04:43:11.938349 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 419/834] 10.222.0.38 () {64 vars in 1308 bytes} [Wed Feb 17 04:43:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:43:12.112452 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-895fecb5-c36b-44c8-a011-23e361ba33ff tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cd0aa08bfc4637a988f25eec8cfb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca59cfbe7f3b494499cc8efe1d0e093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:12.134852 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-895fecb5-c36b-44c8-a011-23e361ba33ff tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] 10.222.0.38 "GET /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2" status: 200 len: 1263 microversion: 2.1 time: 0.580838 Feb 17 04:43:12.146916 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 416/835] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:43:11 2021] GET /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2 => generated 1263 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:43:12.664596 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-fe560380-7b5d-4dac-91d6-03955abd4d52 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:43:12.665376 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-fe560380-7b5d-4dac-91d6-03955abd4d52 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:43:12.674361 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-fe560380-7b5d-4dac-91d6-03955abd4d52 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:12.675118 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-fe560380-7b5d-4dac-91d6-03955abd4d52 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:12.676153 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-fe560380-7b5d-4dac-91d6-03955abd4d52 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:12.676802 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-fe560380-7b5d-4dac-91d6-03955abd4d52 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:13.088933 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-fe560380-7b5d-4dac-91d6-03955abd4d52 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:13.101516 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-fe560380-7b5d-4dac-91d6-03955abd4d52 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:13.103207 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-fe560380-7b5d-4dac-91d6-03955abd4d52 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:13.104492 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-fe560380-7b5d-4dac-91d6-03955abd4d52 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d" status: 200 len: 1738 microversion: 2.20 time: 0.444606 Feb 17 04:43:13.105270 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 420/836] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:43:12 2021] GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d => generated 1738 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:43:13.154982 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-f96a191d-408c-4525-a2dd-28cdc5fff101 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:43:13.155605 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-f96a191d-408c-4525-a2dd-28cdc5fff101 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] [instance: e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:43:13.171043 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f96a191d-408c-4525-a2dd-28cdc5fff101 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:13.171541 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f96a191d-408c-4525-a2dd-28cdc5fff101 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:13.172431 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f96a191d-408c-4525-a2dd-28cdc5fff101 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:13.172949 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f96a191d-408c-4525-a2dd-28cdc5fff101 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:13.668394 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-f96a191d-408c-4525-a2dd-28cdc5fff101 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cd0aa08bfc4637a988f25eec8cfb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca59cfbe7f3b494499cc8efe1d0e093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:13.682502 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-f96a191d-408c-4525-a2dd-28cdc5fff101 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] 10.222.0.38 "GET /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2" status: 200 len: 1263 microversion: 2.1 time: 0.532156 Feb 17 04:43:13.684426 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 417/837] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:43:13 2021] GET /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2 => generated 1263 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:43:14.125834 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-5839b975-1d11-4a3d-9b81-0c9e3cb0f4d0 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:43:14.126515 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-5839b975-1d11-4a3d-9b81-0c9e3cb0f4d0 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:43:14.148882 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5839b975-1d11-4a3d-9b81-0c9e3cb0f4d0 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:14.149865 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5839b975-1d11-4a3d-9b81-0c9e3cb0f4d0 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:14.151061 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5839b975-1d11-4a3d-9b81-0c9e3cb0f4d0 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:14.151721 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5839b975-1d11-4a3d-9b81-0c9e3cb0f4d0 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:14.437386 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-5839b975-1d11-4a3d-9b81-0c9e3cb0f4d0 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:14.449017 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-5839b975-1d11-4a3d-9b81-0c9e3cb0f4d0 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:14.451264 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-5839b975-1d11-4a3d-9b81-0c9e3cb0f4d0 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:14.452836 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-5839b975-1d11-4a3d-9b81-0c9e3cb0f4d0 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d" status: 200 len: 1738 microversion: 2.20 time: 0.331056 Feb 17 04:43:14.453521 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 421/838] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:43:14 2021] GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d => generated 1738 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:43:14.703160 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-993de1c6-e469-494f-ba2d-e7774c8ba94b tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:43:14.704817 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-993de1c6-e469-494f-ba2d-e7774c8ba94b tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] [instance: e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:43:14.714867 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-993de1c6-e469-494f-ba2d-e7774c8ba94b tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:14.715368 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-993de1c6-e469-494f-ba2d-e7774c8ba94b tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:14.716230 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-993de1c6-e469-494f-ba2d-e7774c8ba94b tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:14.716853 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-993de1c6-e469-494f-ba2d-e7774c8ba94b tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:14.999180 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-993de1c6-e469-494f-ba2d-e7774c8ba94b tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cd0aa08bfc4637a988f25eec8cfb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca59cfbe7f3b494499cc8efe1d0e093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:15.010780 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-993de1c6-e469-494f-ba2d-e7774c8ba94b tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] 10.222.0.38 "GET /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2" status: 200 len: 1448 microversion: 2.1 time: 0.312710 Feb 17 04:43:15.011739 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 418/839] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:43:14 2021] GET /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2 => generated 1448 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:43:15.032102 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-db32d2de-084e-4116-b4ba-3b628ece0bef tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:43:15.032778 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-db32d2de-084e-4116-b4ba-3b628ece0bef tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] [instance: e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:43:15.041543 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-db32d2de-084e-4116-b4ba-3b628ece0bef tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:15.042066 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-db32d2de-084e-4116-b4ba-3b628ece0bef tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:15.042452 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-db32d2de-084e-4116-b4ba-3b628ece0bef tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:15.043050 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-db32d2de-084e-4116-b4ba-3b628ece0bef tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:15.473667 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-7dfd39a2-7ae1-4cc4-bff7-6a3fe796a38d tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:43:15.474680 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-7dfd39a2-7ae1-4cc4-bff7-6a3fe796a38d tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:43:15.495722 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7dfd39a2-7ae1-4cc4-bff7-6a3fe796a38d tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:15.499935 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7dfd39a2-7ae1-4cc4-bff7-6a3fe796a38d tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:15.501312 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7dfd39a2-7ae1-4cc4-bff7-6a3fe796a38d tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:15.501833 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7dfd39a2-7ae1-4cc4-bff7-6a3fe796a38d tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:15.503683 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-db32d2de-084e-4116-b4ba-3b628ece0bef tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cd0aa08bfc4637a988f25eec8cfb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca59cfbe7f3b494499cc8efe1d0e093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:15.516372 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-db32d2de-084e-4116-b4ba-3b628ece0bef tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] 10.222.0.38 "GET /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2" status: 200 len: 1448 microversion: 2.1 time: 0.490230 Feb 17 04:43:15.517346 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 422/840] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:43:15 2021] GET /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2 => generated 1448 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:43:15.535270 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-14ef7cb9-b2a8-42f5-ab71-934ff5492aa2 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Action: 'create', calling method: .version_select at 0x7fc2eaa08510>, body: {"pool": null} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:43:16.502001 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-7dfd39a2-7ae1-4cc4-bff7-6a3fe796a38d tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:16.517819 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-7dfd39a2-7ae1-4cc4-bff7-6a3fe796a38d tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:16.519581 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-7dfd39a2-7ae1-4cc4-bff7-6a3fe796a38d tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:16.524194 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-7dfd39a2-7ae1-4cc4-bff7-6a3fe796a38d tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d" status: 200 len: 1738 microversion: 2.20 time: 1.051172 Feb 17 04:43:16.527899 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 419/841] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:43:15 2021] GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d => generated 1738 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 04:43:17.545242 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-8b8aedb3-5151-4512-8fab-6a3354adbb36 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:43:17.546991 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-8b8aedb3-5151-4512-8fab-6a3354adbb36 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:43:17.562968 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8b8aedb3-5151-4512-8fab-6a3354adbb36 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:17.563693 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8b8aedb3-5151-4512-8fab-6a3354adbb36 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:17.573165 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8b8aedb3-5151-4512-8fab-6a3354adbb36 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:17.573888 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8b8aedb3-5151-4512-8fab-6a3354adbb36 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:18.405473 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-8b8aedb3-5151-4512-8fab-6a3354adbb36 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:18.427459 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-8b8aedb3-5151-4512-8fab-6a3354adbb36 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:18.435059 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-8b8aedb3-5151-4512-8fab-6a3354adbb36 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:18.436108 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-8b8aedb3-5151-4512-8fab-6a3354adbb36 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d" status: 200 len: 1738 microversion: 2.20 time: 0.895515 Feb 17 04:43:18.436731 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 420/842] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:43:17 2021] GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d => generated 1738 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 04:43:19.249949 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-14ef7cb9-b2a8-42f5-ab71-934ff5492aa2 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] 10.222.0.38 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.718607 Feb 17 04:43:19.251275 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 423/843] 10.222.0.38 () {60 vars in 1160 bytes} [Wed Feb 17 04:43:15 2021] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3721 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:43:19.263995 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-16621f86-acfc-4a99-8801-e9b02f83991b tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Action: 'action', calling method: .version_select at 0x7fc2eb637ae8>, body: {"addFloatingIp": {"address": "172.27.0.243"}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:43:19.265663 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-16621f86-acfc-4a99-8801-e9b02f83991b tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] [instance: e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:43:19.274359 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-16621f86-acfc-4a99-8801-e9b02f83991b tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:19.275244 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-16621f86-acfc-4a99-8801-e9b02f83991b tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:19.276314 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-16621f86-acfc-4a99-8801-e9b02f83991b tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:19.277051 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-16621f86-acfc-4a99-8801-e9b02f83991b tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:19.379157 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-16621f86-acfc-4a99-8801-e9b02f83991b tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Acquired lock "refresh_cache-e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2" {{(pid=98080) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Feb 17 04:43:19.508726 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-3bdb15f1-708b-48cb-96dd-965d7e286c1a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:43:19.509694 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-3bdb15f1-708b-48cb-96dd-965d7e286c1a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:43:19.518812 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-3bdb15f1-708b-48cb-96dd-965d7e286c1a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:19.519661 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-3bdb15f1-708b-48cb-96dd-965d7e286c1a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:19.520883 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-3bdb15f1-708b-48cb-96dd-965d7e286c1a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:19.521591 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-3bdb15f1-708b-48cb-96dd-965d7e286c1a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:20.190935 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-3bdb15f1-708b-48cb-96dd-965d7e286c1a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:20.200495 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-3bdb15f1-708b-48cb-96dd-965d7e286c1a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:20.202718 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-3bdb15f1-708b-48cb-96dd-965d7e286c1a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:20.203914 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-3bdb15f1-708b-48cb-96dd-965d7e286c1a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d" status: 200 len: 1738 microversion: 2.20 time: 0.706282 Feb 17 04:43:20.204509 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 424/844] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:43:19 2021] GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d => generated 1738 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 04:43:21.224731 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-1276933c-6fb8-4bae-baf3-503e9df85fee tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:43:21.225591 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-1276933c-6fb8-4bae-baf3-503e9df85fee tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:43:21.238365 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1276933c-6fb8-4bae-baf3-503e9df85fee tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:21.239282 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1276933c-6fb8-4bae-baf3-503e9df85fee tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:21.240260 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1276933c-6fb8-4bae-baf3-503e9df85fee tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:21.240757 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1276933c-6fb8-4bae-baf3-503e9df85fee tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:22.002130 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-1276933c-6fb8-4bae-baf3-503e9df85fee tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:22.011404 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-1276933c-6fb8-4bae-baf3-503e9df85fee tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:22.013554 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-1276933c-6fb8-4bae-baf3-503e9df85fee tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:22.014957 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-1276933c-6fb8-4bae-baf3-503e9df85fee tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d" status: 200 len: 1720 microversion: 2.20 time: 0.795028 Feb 17 04:43:22.015546 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 425/845] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:43:21 2021] GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d => generated 1720 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 04:43:22.213752 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.network.neutron [None req-16621f86-acfc-4a99-8801-e9b02f83991b tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] [instance: e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2] Building network info cache for instance {{(pid=98080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1836}} Feb 17 04:43:22.230264 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [req-ad982495-2e66-43c0-9b2e-52e9f3cffa34 req-71e58d3c-39c2-4da6-bf4c-bfb412f1dabb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2", "tag": "6738a807-1bee-443c-9281-dcce36604367"}]} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:43:22.232107 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:43:22.232107 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:43:22.241074 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-ad982495-2e66-43c0-9b2e-52e9f3cffa34 req-71e58d3c-39c2-4da6-bf4c-bfb412f1dabb service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:22.241575 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-ad982495-2e66-43c0-9b2e-52e9f3cffa34 req-71e58d3c-39c2-4da6-bf4c-bfb412f1dabb service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:22.261900 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.compute.server_external_events [req-ad982495-2e66-43c0-9b2e-52e9f3cffa34 req-71e58d3c-39c2-4da6-bf4c-bfb412f1dabb service nova] Creating event network-changed:6738a807-1bee-443c-9281-dcce36604367 for instance e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2 on hv-cinder-76019 Feb 17 04:43:22.268406 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [req-ad982495-2e66-43c0-9b2e-52e9f3cffa34 req-71e58d3c-39c2-4da6-bf4c-bfb412f1dabb service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042248 Feb 17 04:43:22.269203 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 426/846] 10.222.0.38 () {64 vars in 1308 bytes} [Wed Feb 17 04:43:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:43:23.038688 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-3370e762-72fe-4c8d-8b80-af2ce935a52b tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:43:23.039831 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-3370e762-72fe-4c8d-8b80-af2ce935a52b tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:43:23.051064 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-3370e762-72fe-4c8d-8b80-af2ce935a52b tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:23.052333 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-3370e762-72fe-4c8d-8b80-af2ce935a52b tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:23.053427 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-3370e762-72fe-4c8d-8b80-af2ce935a52b tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:23.055007 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-3370e762-72fe-4c8d-8b80-af2ce935a52b tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:23.907599 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-3370e762-72fe-4c8d-8b80-af2ce935a52b tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:23.917468 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-3370e762-72fe-4c8d-8b80-af2ce935a52b tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:23.919636 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-3370e762-72fe-4c8d-8b80-af2ce935a52b tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:23.921034 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-3370e762-72fe-4c8d-8b80-af2ce935a52b tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d" status: 200 len: 1720 microversion: 2.20 time: 0.889305 Feb 17 04:43:23.933459 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 427/847] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:43:23 2021] GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d => generated 1720 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 04:43:24.795426 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.network.neutron [None req-16621f86-acfc-4a99-8801-e9b02f83991b tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] [instance: e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2] Updating instance_info_cache with network_info: [{"id": "6738a807-1bee-443c-9281-dcce36604367", "address": "fa:16:3e:a0:4b:ec", "network": {"id": "3468340d-819b-4c91-9b3c-03f43d53a90d", "bridge": "br-int", "label": "tempest-TestShelveInstance-2100110560-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.27.0.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "ca59cfbe7f3b494499cc8efe1d0e093e", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tap6738a807-1b", "ovs_interfaceid": "6738a807-1bee-443c-9281-dcce36604367", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=98080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Feb 17 04:43:24.811615 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-16621f86-acfc-4a99-8801-e9b02f83991b tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Releasing lock "refresh_cache-e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2" {{(pid=98080) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Feb 17 04:43:24.812811 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-16621f86-acfc-4a99-8801-e9b02f83991b tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] 10.222.0.38 "POST /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2/action" status: 202 len: 0 microversion: 2.1 time: 5.553959 Feb 17 04:43:24.813688 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 421/848] 10.222.0.38 () {60 vars in 1268 bytes} [Wed Feb 17 04:43:19 2021] POST /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2/action => generated 0 bytes in 5555 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Feb 17 04:43:24.941520 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-6f1cfdcf-dbcf-4eaf-8cc0-18b76cc19914 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:43:24.942080 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-6f1cfdcf-dbcf-4eaf-8cc0-18b76cc19914 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:43:24.950171 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6f1cfdcf-dbcf-4eaf-8cc0-18b76cc19914 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:24.951397 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6f1cfdcf-dbcf-4eaf-8cc0-18b76cc19914 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:24.952250 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6f1cfdcf-dbcf-4eaf-8cc0-18b76cc19914 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:24.952723 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6f1cfdcf-dbcf-4eaf-8cc0-18b76cc19914 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:25.184116 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [req-ac425477-f7aa-47c5-beb8-1513db9bcd7b req-86bac5ab-bc5f-4a9a-9e28-132b2cb30e91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65811bec-2a80-4c2b-a424-f2a986a6055d", "name": "network-vif-unplugged", "status": "completed", "tag": "84c73f3d-c8e5-45a0-9371-0d806cb29e7b"}]} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:43:25.186874 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:43:25.186874 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:43:25.198999 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-ac425477-f7aa-47c5-beb8-1513db9bcd7b req-86bac5ab-bc5f-4a9a-9e28-132b2cb30e91 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:25.199672 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-ac425477-f7aa-47c5-beb8-1513db9bcd7b req-86bac5ab-bc5f-4a9a-9e28-132b2cb30e91 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:25.231058 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.compute.server_external_events [req-ac425477-f7aa-47c5-beb8-1513db9bcd7b req-86bac5ab-bc5f-4a9a-9e28-132b2cb30e91 service nova] Creating event network-vif-unplugged:84c73f3d-c8e5-45a0-9371-0d806cb29e7b for instance 65811bec-2a80-4c2b-a424-f2a986a6055d on hv-cinder-76019 Feb 17 04:43:25.237656 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [req-ac425477-f7aa-47c5-beb8-1513db9bcd7b req-86bac5ab-bc5f-4a9a-9e28-132b2cb30e91 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060803 Feb 17 04:43:25.239284 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 422/849] 10.222.0.38 () {64 vars in 1308 bytes} [Wed Feb 17 04:43:25 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:43:25.542864 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-6f1cfdcf-dbcf-4eaf-8cc0-18b76cc19914 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:25.552936 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-6f1cfdcf-dbcf-4eaf-8cc0-18b76cc19914 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:25.554510 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-6f1cfdcf-dbcf-4eaf-8cc0-18b76cc19914 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:25.555735 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-6f1cfdcf-dbcf-4eaf-8cc0-18b76cc19914 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d" status: 200 len: 1723 microversion: 2.20 time: 0.618679 Feb 17 04:43:25.556329 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 428/850] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:43:24 2021] GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d => generated 1723 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:43:25.576587 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-54a42648-58c4-448c-ac35-040c16fd77c8 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2cc53d15-1629-4cf5-b786-cb7d233d7606"}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:43:25.577850 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-54a42648-58c4-448c-ac35-040c16fd77c8 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:43:25.585975 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-54a42648-58c4-448c-ac35-040c16fd77c8 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:25.586481 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-54a42648-58c4-448c-ac35-040c16fd77c8 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:25.587361 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-54a42648-58c4-448c-ac35-040c16fd77c8 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:25.587853 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-54a42648-58c4-448c-ac35-040c16fd77c8 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:26.024827 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-54a42648-58c4-448c-ac35-040c16fd77c8 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "POST /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.453391 Feb 17 04:43:26.025496 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 423/851] 10.222.0.38 () {62 vars in 1354 bytes} [Wed Feb 17 04:43:25 2021] POST /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d/os-volume_attachments => generated 188 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:43:26.149393 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-d77ecf8b-aa1e-47b7-8954-e45652e7c855 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:43:26.149939 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-d77ecf8b-aa1e-47b7-8954-e45652e7c855 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:43:26.159183 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d77ecf8b-aa1e-47b7-8954-e45652e7c855 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:26.159698 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d77ecf8b-aa1e-47b7-8954-e45652e7c855 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:26.160542 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d77ecf8b-aa1e-47b7-8954-e45652e7c855 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:26.161046 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d77ecf8b-aa1e-47b7-8954-e45652e7c855 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:26.637244 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-d77ecf8b-aa1e-47b7-8954-e45652e7c855 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "DELETE /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d/os-volume_attachments/2cc53d15-1629-4cf5-b786-cb7d233d7606" status: 202 len: 0 microversion: 2.20 time: 0.491853 Feb 17 04:43:26.637945 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 429/852] 10.222.0.38 () {60 vars in 1447 bytes} [Wed Feb 17 04:43:26 2021] DELETE /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d/os-volume_attachments/2cc53d15-1629-4cf5-b786-cb7d233d7606 => generated 0 bytes in 493 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 17 04:43:26.756537 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-8bd39f75-457d-406b-85bb-18dabcf897e8 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:43:26.757190 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-8bd39f75-457d-406b-85bb-18dabcf897e8 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:43:26.765792 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8bd39f75-457d-406b-85bb-18dabcf897e8 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:26.766300 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8bd39f75-457d-406b-85bb-18dabcf897e8 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:26.767184 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8bd39f75-457d-406b-85bb-18dabcf897e8 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:26.767680 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8bd39f75-457d-406b-85bb-18dabcf897e8 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:26.922447 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-8bd39f75-457d-406b-85bb-18dabcf897e8 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "POST /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d/action" status: 202 len: 0 microversion: 2.20 time: 0.170190 Feb 17 04:43:26.923084 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 424/853] 10.222.0.38 () {62 vars in 1309 bytes} [Wed Feb 17 04:43:26 2021] POST /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d/action => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 17 04:43:26.931845 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-ca03c3de-090a-49c6-8bdf-de67eeebe219 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:43:26.932661 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-ca03c3de-090a-49c6-8bdf-de67eeebe219 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:43:26.941059 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ca03c3de-090a-49c6-8bdf-de67eeebe219 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:26.941582 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ca03c3de-090a-49c6-8bdf-de67eeebe219 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:26.942443 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ca03c3de-090a-49c6-8bdf-de67eeebe219 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:26.942984 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ca03c3de-090a-49c6-8bdf-de67eeebe219 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:27.155964 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-ca03c3de-090a-49c6-8bdf-de67eeebe219 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:27.165519 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-ca03c3de-090a-49c6-8bdf-de67eeebe219 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:27.167130 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-ca03c3de-090a-49c6-8bdf-de67eeebe219 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:27.168319 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-ca03c3de-090a-49c6-8bdf-de67eeebe219 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d" status: 200 len: 1671 microversion: 2.20 time: 0.240597 Feb 17 04:43:27.168914 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 430/854] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:43:26 2021] GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d => generated 1671 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 04:43:28.190127 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-034c3e01-ea20-44e1-b3db-60646df24065 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:43:28.190843 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-034c3e01-ea20-44e1-b3db-60646df24065 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:43:28.198843 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-034c3e01-ea20-44e1-b3db-60646df24065 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:28.199361 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-034c3e01-ea20-44e1-b3db-60646df24065 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:28.200219 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-034c3e01-ea20-44e1-b3db-60646df24065 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:28.200730 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-034c3e01-ea20-44e1-b3db-60646df24065 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:28.551886 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-034c3e01-ea20-44e1-b3db-60646df24065 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:28.562884 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-034c3e01-ea20-44e1-b3db-60646df24065 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:28.564702 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-034c3e01-ea20-44e1-b3db-60646df24065 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:28.565903 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-034c3e01-ea20-44e1-b3db-60646df24065 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d" status: 200 len: 1673 microversion: 2.20 time: 0.380908 Feb 17 04:43:28.566507 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 425/855] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:43:28 2021] GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d => generated 1673 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:43:29.586090 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-073a7678-147b-4469-b205-87f902d98b45 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:43:29.587645 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-073a7678-147b-4469-b205-87f902d98b45 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:43:29.597935 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-073a7678-147b-4469-b205-87f902d98b45 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:29.598638 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-073a7678-147b-4469-b205-87f902d98b45 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:29.599577 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-073a7678-147b-4469-b205-87f902d98b45 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:29.600160 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-073a7678-147b-4469-b205-87f902d98b45 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:29.837080 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-073a7678-147b-4469-b205-87f902d98b45 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:29.847328 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-073a7678-147b-4469-b205-87f902d98b45 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:29.848881 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-073a7678-147b-4469-b205-87f902d98b45 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:29.850067 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-073a7678-147b-4469-b205-87f902d98b45 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d" status: 200 len: 1729 microversion: 2.20 time: 0.268443 Feb 17 04:43:29.850678 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 431/856] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:43:29 2021] GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d => generated 1729 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 04:43:30.869552 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-284b1f2c-8c37-4a2d-a155-046d24f38e66 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:43:30.870390 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-284b1f2c-8c37-4a2d-a155-046d24f38e66 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:43:30.880024 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-284b1f2c-8c37-4a2d-a155-046d24f38e66 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:30.880628 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-284b1f2c-8c37-4a2d-a155-046d24f38e66 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:30.881568 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-284b1f2c-8c37-4a2d-a155-046d24f38e66 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:30.882146 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-284b1f2c-8c37-4a2d-a155-046d24f38e66 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:31.129205 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-284b1f2c-8c37-4a2d-a155-046d24f38e66 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:31.138751 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-284b1f2c-8c37-4a2d-a155-046d24f38e66 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:31.140338 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-284b1f2c-8c37-4a2d-a155-046d24f38e66 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:31.141569 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-284b1f2c-8c37-4a2d-a155-046d24f38e66 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d" status: 200 len: 1729 microversion: 2.20 time: 0.276059 Feb 17 04:43:31.142164 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 426/857] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:43:30 2021] GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d => generated 1729 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:43:32.161608 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-ac629c06-82a2-4b61-86a9-af7ddbd0e49a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:43:32.162283 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-ac629c06-82a2-4b61-86a9-af7ddbd0e49a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:43:32.172157 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ac629c06-82a2-4b61-86a9-af7ddbd0e49a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:32.172664 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ac629c06-82a2-4b61-86a9-af7ddbd0e49a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:32.173729 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ac629c06-82a2-4b61-86a9-af7ddbd0e49a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:32.174322 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ac629c06-82a2-4b61-86a9-af7ddbd0e49a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:32.415063 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-ac629c06-82a2-4b61-86a9-af7ddbd0e49a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:32.425393 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-ac629c06-82a2-4b61-86a9-af7ddbd0e49a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:32.427023 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-ac629c06-82a2-4b61-86a9-af7ddbd0e49a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:32.428207 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-ac629c06-82a2-4b61-86a9-af7ddbd0e49a tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d" status: 200 len: 1729 microversion: 2.20 time: 0.270680 Feb 17 04:43:32.428805 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 432/858] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:43:32 2021] GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d => generated 1729 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:43:33.449559 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-b65df5eb-eb4d-4ded-b696-04630185c11f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:43:33.450370 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-b65df5eb-eb4d-4ded-b696-04630185c11f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:43:33.459884 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b65df5eb-eb4d-4ded-b696-04630185c11f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:33.460391 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b65df5eb-eb4d-4ded-b696-04630185c11f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:33.461244 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b65df5eb-eb4d-4ded-b696-04630185c11f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:33.461746 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b65df5eb-eb4d-4ded-b696-04630185c11f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:33.691211 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-b65df5eb-eb4d-4ded-b696-04630185c11f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:33.700421 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-b65df5eb-eb4d-4ded-b696-04630185c11f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:33.702705 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-b65df5eb-eb4d-4ded-b696-04630185c11f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:33.703886 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-b65df5eb-eb4d-4ded-b696-04630185c11f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d" status: 200 len: 1729 microversion: 2.20 time: 0.258398 Feb 17 04:43:33.704473 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 427/859] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:43:33 2021] GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d => generated 1729 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:43:34.724067 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-d0616f8a-f304-46fa-bc99-59f4651a04ff tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:43:34.724732 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-d0616f8a-f304-46fa-bc99-59f4651a04ff tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:43:34.732857 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d0616f8a-f304-46fa-bc99-59f4651a04ff tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:34.733373 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d0616f8a-f304-46fa-bc99-59f4651a04ff tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:34.734220 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d0616f8a-f304-46fa-bc99-59f4651a04ff tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:34.734748 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d0616f8a-f304-46fa-bc99-59f4651a04ff tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:34.963839 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-d0616f8a-f304-46fa-bc99-59f4651a04ff tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:34.974133 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-d0616f8a-f304-46fa-bc99-59f4651a04ff tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:34.975764 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-d0616f8a-f304-46fa-bc99-59f4651a04ff tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:34.977062 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-d0616f8a-f304-46fa-bc99-59f4651a04ff tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d" status: 200 len: 1729 microversion: 2.20 time: 0.257014 Feb 17 04:43:34.977654 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 433/860] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:43:34 2021] GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d => generated 1729 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:43:35.998045 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-1230fb6c-443c-4b41-a781-6545f62983d3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:43:35.998728 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-1230fb6c-443c-4b41-a781-6545f62983d3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:43:36.006843 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1230fb6c-443c-4b41-a781-6545f62983d3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:36.007358 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1230fb6c-443c-4b41-a781-6545f62983d3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:36.008222 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1230fb6c-443c-4b41-a781-6545f62983d3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:36.008785 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1230fb6c-443c-4b41-a781-6545f62983d3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:36.229153 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-1230fb6c-443c-4b41-a781-6545f62983d3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:36.239007 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-1230fb6c-443c-4b41-a781-6545f62983d3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:36.240865 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-1230fb6c-443c-4b41-a781-6545f62983d3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:36.242079 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-1230fb6c-443c-4b41-a781-6545f62983d3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d" status: 200 len: 1729 microversion: 2.20 time: 0.248362 Feb 17 04:43:36.242701 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 428/861] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:43:35 2021] GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d => generated 1729 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:43:37.261772 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-a86ad0c5-b75f-4c0e-8195-c4eba2c1cccc tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:43:37.262441 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-a86ad0c5-b75f-4c0e-8195-c4eba2c1cccc tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:43:37.271260 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a86ad0c5-b75f-4c0e-8195-c4eba2c1cccc tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:37.271770 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a86ad0c5-b75f-4c0e-8195-c4eba2c1cccc tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:37.272605 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a86ad0c5-b75f-4c0e-8195-c4eba2c1cccc tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:37.273102 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a86ad0c5-b75f-4c0e-8195-c4eba2c1cccc tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:37.494233 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-a86ad0c5-b75f-4c0e-8195-c4eba2c1cccc tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:37.504412 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-a86ad0c5-b75f-4c0e-8195-c4eba2c1cccc tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:37.505989 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-a86ad0c5-b75f-4c0e-8195-c4eba2c1cccc tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:37.507243 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-a86ad0c5-b75f-4c0e-8195-c4eba2c1cccc tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d" status: 200 len: 1729 microversion: 2.20 time: 0.249549 Feb 17 04:43:37.507832 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 434/862] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:43:37 2021] GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d => generated 1729 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:43:38.527790 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-e9697901-b1b3-4c5f-8496-9d95bc7b2fc3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:43:38.528495 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-e9697901-b1b3-4c5f-8496-9d95bc7b2fc3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:43:38.537303 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e9697901-b1b3-4c5f-8496-9d95bc7b2fc3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:38.537813 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e9697901-b1b3-4c5f-8496-9d95bc7b2fc3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:38.538664 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e9697901-b1b3-4c5f-8496-9d95bc7b2fc3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:38.539280 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e9697901-b1b3-4c5f-8496-9d95bc7b2fc3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:38.766230 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-e9697901-b1b3-4c5f-8496-9d95bc7b2fc3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:38.775933 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-e9697901-b1b3-4c5f-8496-9d95bc7b2fc3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:38.777444 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-e9697901-b1b3-4c5f-8496-9d95bc7b2fc3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:38.778714 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-e9697901-b1b3-4c5f-8496-9d95bc7b2fc3 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d" status: 200 len: 1729 microversion: 2.20 time: 0.254860 Feb 17 04:43:38.779669 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 429/863] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:43:38 2021] GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d => generated 1729 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:43:39.799626 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-1d363295-928a-4c1d-8183-db06fffe8757 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:43:39.800289 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-1d363295-928a-4c1d-8183-db06fffe8757 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:43:39.808209 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1d363295-928a-4c1d-8183-db06fffe8757 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:39.808974 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1d363295-928a-4c1d-8183-db06fffe8757 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:39.809813 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1d363295-928a-4c1d-8183-db06fffe8757 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:39.810313 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1d363295-928a-4c1d-8183-db06fffe8757 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:40.058534 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-1d363295-928a-4c1d-8183-db06fffe8757 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:40.071661 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-1d363295-928a-4c1d-8183-db06fffe8757 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:40.073896 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-1d363295-928a-4c1d-8183-db06fffe8757 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:40.075430 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-1d363295-928a-4c1d-8183-db06fffe8757 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d" status: 200 len: 1729 microversion: 2.20 time: 0.280500 Feb 17 04:43:40.076736 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 435/864] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:43:39 2021] GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d => generated 1729 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:43:41.097281 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-194b1ad7-ef96-407e-8743-467d0959ab1e tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:43:41.097945 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-194b1ad7-ef96-407e-8743-467d0959ab1e tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:43:41.105829 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-194b1ad7-ef96-407e-8743-467d0959ab1e tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:41.106342 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-194b1ad7-ef96-407e-8743-467d0959ab1e tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:41.107868 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-194b1ad7-ef96-407e-8743-467d0959ab1e tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:41.108331 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-194b1ad7-ef96-407e-8743-467d0959ab1e tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:41.321529 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-194b1ad7-ef96-407e-8743-467d0959ab1e tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:41.331585 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-194b1ad7-ef96-407e-8743-467d0959ab1e tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:41.333191 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-194b1ad7-ef96-407e-8743-467d0959ab1e tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:41.334436 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-194b1ad7-ef96-407e-8743-467d0959ab1e tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d" status: 200 len: 1729 microversion: 2.20 time: 0.241276 Feb 17 04:43:41.335062 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 430/865] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:43:41 2021] GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d => generated 1729 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:43:42.353548 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-14f0e4a0-d58f-4023-af6b-7aac27df68b4 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:43:42.354209 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-14f0e4a0-d58f-4023-af6b-7aac27df68b4 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:43:42.362093 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-14f0e4a0-d58f-4023-af6b-7aac27df68b4 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:42.362640 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-14f0e4a0-d58f-4023-af6b-7aac27df68b4 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:42.363478 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-14f0e4a0-d58f-4023-af6b-7aac27df68b4 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:42.363967 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-14f0e4a0-d58f-4023-af6b-7aac27df68b4 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:42.573084 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-14f0e4a0-d58f-4023-af6b-7aac27df68b4 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:42.583036 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-14f0e4a0-d58f-4023-af6b-7aac27df68b4 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:42.584608 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-14f0e4a0-d58f-4023-af6b-7aac27df68b4 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:42.585790 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-14f0e4a0-d58f-4023-af6b-7aac27df68b4 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d" status: 200 len: 1729 microversion: 2.20 time: 0.236293 Feb 17 04:43:42.586387 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 436/866] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:43:42 2021] GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d => generated 1729 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:43:43.606078 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-d9962732-7ac6-42a7-bad7-c3924c9a87f1 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:43:43.606887 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-d9962732-7ac6-42a7-bad7-c3924c9a87f1 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:43:43.615362 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d9962732-7ac6-42a7-bad7-c3924c9a87f1 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:43.615871 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d9962732-7ac6-42a7-bad7-c3924c9a87f1 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:43.616705 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d9962732-7ac6-42a7-bad7-c3924c9a87f1 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:43.617196 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d9962732-7ac6-42a7-bad7-c3924c9a87f1 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:43.765835 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [req-7a665321-10ab-4de9-a4fa-3860dbf67cb2 req-70dcc8c8-33be-4ae9-9373-93b5084cd8ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65811bec-2a80-4c2b-a424-f2a986a6055d", "name": "network-vif-plugged", "status": "completed", "tag": "84c73f3d-c8e5-45a0-9371-0d806cb29e7b"}]} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:43:43.767867 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:43:43.767867 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:43:43.778015 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-7a665321-10ab-4de9-a4fa-3860dbf67cb2 req-70dcc8c8-33be-4ae9-9373-93b5084cd8ca service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:43.778459 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-7a665321-10ab-4de9-a4fa-3860dbf67cb2 req-70dcc8c8-33be-4ae9-9373-93b5084cd8ca service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:43.797238 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.compute.server_external_events [req-7a665321-10ab-4de9-a4fa-3860dbf67cb2 req-70dcc8c8-33be-4ae9-9373-93b5084cd8ca service nova] Creating event network-vif-plugged:84c73f3d-c8e5-45a0-9371-0d806cb29e7b for instance 65811bec-2a80-4c2b-a424-f2a986a6055d on hv-cinder-76019 Feb 17 04:43:43.802535 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [req-7a665321-10ab-4de9-a4fa-3860dbf67cb2 req-70dcc8c8-33be-4ae9-9373-93b5084cd8ca service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042940 Feb 17 04:43:43.803387 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 437/867] 10.222.0.38 () {64 vars in 1308 bytes} [Wed Feb 17 04:43:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:43:43.838557 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-d9962732-7ac6-42a7-bad7-c3924c9a87f1 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:43.848878 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-d9962732-7ac6-42a7-bad7-c3924c9a87f1 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:43.850580 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-d9962732-7ac6-42a7-bad7-c3924c9a87f1 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:43.851932 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-d9962732-7ac6-42a7-bad7-c3924c9a87f1 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d" status: 200 len: 1729 microversion: 2.20 time: 0.250194 Feb 17 04:43:43.852535 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 431/868] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:43:43 2021] GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d => generated 1729 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:43:44.872371 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-79c49e89-958e-42da-9907-364f8a7af3f8 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:43:44.873404 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-79c49e89-958e-42da-9907-364f8a7af3f8 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:43:44.881750 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-79c49e89-958e-42da-9907-364f8a7af3f8 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:44.882269 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-79c49e89-958e-42da-9907-364f8a7af3f8 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:44.883150 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-79c49e89-958e-42da-9907-364f8a7af3f8 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:44.883655 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-79c49e89-958e-42da-9907-364f8a7af3f8 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:45.105429 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-79c49e89-958e-42da-9907-364f8a7af3f8 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:45.114702 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-79c49e89-958e-42da-9907-364f8a7af3f8 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:45.116279 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-79c49e89-958e-42da-9907-364f8a7af3f8 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:45.117459 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-79c49e89-958e-42da-9907-364f8a7af3f8 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d" status: 200 len: 1729 microversion: 2.20 time: 0.249669 Feb 17 04:43:45.118047 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 438/869] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:43:44 2021] GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d => generated 1729 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:43:46.136947 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-c982ab7f-e6d3-41ce-8901-8a35f705bf4f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:43:46.137623 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-c982ab7f-e6d3-41ce-8901-8a35f705bf4f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:43:46.146040 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c982ab7f-e6d3-41ce-8901-8a35f705bf4f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:46.146555 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c982ab7f-e6d3-41ce-8901-8a35f705bf4f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:46.147444 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c982ab7f-e6d3-41ce-8901-8a35f705bf4f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:43:46.147942 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c982ab7f-e6d3-41ce-8901-8a35f705bf4f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:43:46.358315 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-c982ab7f-e6d3-41ce-8901-8a35f705bf4f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:46.367733 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-c982ab7f-e6d3-41ce-8901-8a35f705bf4f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:46.369301 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-c982ab7f-e6d3-41ce-8901-8a35f705bf4f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:43:46.370495 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-c982ab7f-e6d3-41ce-8901-8a35f705bf4f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d" status: 200 len: 1716 microversion: 2.20 time: 0.237714 Feb 17 04:43:46.371121 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 432/870] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:43:46 2021] GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d => generated 1716 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:44:15.238137 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-974a339e-86db-417e-84ed-c74b49a2030c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:44:15.238718 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-974a339e-86db-417e-84ed-c74b49a2030c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:44:15.247487 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-974a339e-86db-417e-84ed-c74b49a2030c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:15.248221 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-974a339e-86db-417e-84ed-c74b49a2030c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:15.248829 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-974a339e-86db-417e-84ed-c74b49a2030c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:15.249330 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-974a339e-86db-417e-84ed-c74b49a2030c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:15.314106 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-974a339e-86db-417e-84ed-c74b49a2030c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Going to try to terminate instance {{(pid=98081) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 04:44:15.426842 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-974a339e-86db-417e-84ed-c74b49a2030c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "DELETE /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d" status: 204 len: 0 microversion: 2.20 time: 0.192580 Feb 17 04:44:15.427670 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 439/871] 10.222.0.38 () {60 vars in 1270 bytes} [Wed Feb 17 04:44:15 2021] DELETE /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 17 04:44:15.437048 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-f690402c-ceb8-4958-b41f-20e9240b722c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:44:15.437727 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-f690402c-ceb8-4958-b41f-20e9240b722c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:44:15.445618 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f690402c-ceb8-4958-b41f-20e9240b722c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:15.446136 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f690402c-ceb8-4958-b41f-20e9240b722c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:15.447016 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f690402c-ceb8-4958-b41f-20e9240b722c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:15.447522 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f690402c-ceb8-4958-b41f-20e9240b722c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:15.659987 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-f690402c-ceb8-4958-b41f-20e9240b722c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:44:15.669262 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-f690402c-ceb8-4958-b41f-20e9240b722c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:44:15.670926 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-f690402c-ceb8-4958-b41f-20e9240b722c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:44:15.672085 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-f690402c-ceb8-4958-b41f-20e9240b722c tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d" status: 200 len: 1722 microversion: 2.20 time: 0.240078 Feb 17 04:44:15.672667 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 433/872] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:44:15 2021] GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d => generated 1722 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:44:16.693032 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-f4b8acd6-652f-429d-aaac-259064d1203f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:44:16.693806 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-f4b8acd6-652f-429d-aaac-259064d1203f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:44:16.701620 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f4b8acd6-652f-429d-aaac-259064d1203f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:16.702131 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f4b8acd6-652f-429d-aaac-259064d1203f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:16.703002 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f4b8acd6-652f-429d-aaac-259064d1203f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:16.703500 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f4b8acd6-652f-429d-aaac-259064d1203f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:16.974456 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-f4b8acd6-652f-429d-aaac-259064d1203f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:44:16.985725 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-f4b8acd6-652f-429d-aaac-259064d1203f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:44:16.987800 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-f4b8acd6-652f-429d-aaac-259064d1203f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:44:16.989160 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-f4b8acd6-652f-429d-aaac-259064d1203f tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d" status: 200 len: 1722 microversion: 2.20 time: 0.300532 Feb 17 04:44:16.989970 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 440/873] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:44:16 2021] GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d => generated 1722 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:44:17.571229 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [req-78916ead-853b-45a4-891a-3f5d56792474 req-c063b27c-4472-4008-ad42-5643c99c6f05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65811bec-2a80-4c2b-a424-f2a986a6055d", "name": "network-vif-unplugged", "status": "completed", "tag": "84c73f3d-c8e5-45a0-9371-0d806cb29e7b"}]} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:44:17.573376 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:44:17.573376 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:44:17.584158 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-78916ead-853b-45a4-891a-3f5d56792474 req-c063b27c-4472-4008-ad42-5643c99c6f05 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:17.584672 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-78916ead-853b-45a4-891a-3f5d56792474 req-c063b27c-4472-4008-ad42-5643c99c6f05 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:17.602520 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.compute.server_external_events [req-78916ead-853b-45a4-891a-3f5d56792474 req-c063b27c-4472-4008-ad42-5643c99c6f05 service nova] Creating event network-vif-unplugged:84c73f3d-c8e5-45a0-9371-0d806cb29e7b for instance 65811bec-2a80-4c2b-a424-f2a986a6055d on hv-cinder-76019 Feb 17 04:44:17.607758 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [req-78916ead-853b-45a4-891a-3f5d56792474 req-c063b27c-4472-4008-ad42-5643c99c6f05 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041789 Feb 17 04:44:17.608394 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 434/874] 10.222.0.38 () {64 vars in 1308 bytes} [Wed Feb 17 04:44:17 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:44:18.009612 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-2088be65-964b-4237-8a9a-a7b3b1052649 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:44:18.010290 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-2088be65-964b-4237-8a9a-a7b3b1052649 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:44:18.018869 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2088be65-964b-4237-8a9a-a7b3b1052649 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:18.019390 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2088be65-964b-4237-8a9a-a7b3b1052649 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:18.020275 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2088be65-964b-4237-8a9a-a7b3b1052649 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:18.020776 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2088be65-964b-4237-8a9a-a7b3b1052649 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:18.678092 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-2088be65-964b-4237-8a9a-a7b3b1052649 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:44:18.687828 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-2088be65-964b-4237-8a9a-a7b3b1052649 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:44:18.689376 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-2088be65-964b-4237-8a9a-a7b3b1052649 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:44:18.690554 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-2088be65-964b-4237-8a9a-a7b3b1052649 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d" status: 200 len: 1722 microversion: 2.20 time: 0.684989 Feb 17 04:44:18.691188 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 441/875] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:44:18 2021] GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d => generated 1722 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:44:19.710455 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-c04c51a9-4639-46dc-83fc-df4d3528a054 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:44:19.711169 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-c04c51a9-4639-46dc-83fc-df4d3528a054 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:44:19.719268 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c04c51a9-4639-46dc-83fc-df4d3528a054 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:19.719771 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c04c51a9-4639-46dc-83fc-df4d3528a054 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:19.720602 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c04c51a9-4639-46dc-83fc-df4d3528a054 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:19.721091 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c04c51a9-4639-46dc-83fc-df4d3528a054 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:19.892814 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [req-1b99048b-ff31-4f5d-b7e8-5789775a5334 req-5347b8bf-8c68-44e5-ab02-2f71f11d61c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65811bec-2a80-4c2b-a424-f2a986a6055d", "name": "network-vif-deleted", "tag": "84c73f3d-c8e5-45a0-9371-0d806cb29e7b"}]} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:44:19.895042 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:44:19.895042 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:44:19.901211 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-c04c51a9-4639-46dc-83fc-df4d3528a054 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:44:19.912571 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-1b99048b-ff31-4f5d-b7e8-5789775a5334 req-5347b8bf-8c68-44e5-ab02-2f71f11d61c8 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:19.913151 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-1b99048b-ff31-4f5d-b7e8-5789775a5334 req-5347b8bf-8c68-44e5-ab02-2f71f11d61c8 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:19.914848 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-c04c51a9-4639-46dc-83fc-df4d3528a054 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:44:19.916458 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-c04c51a9-4639-46dc-83fc-df4d3528a054 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '24b1af7d956f42a19ef0e6a9a753b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669aa7253aff4985a447b249c23aa338', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:44:19.917853 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-c04c51a9-4639-46dc-83fc-df4d3528a054 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d" status: 200 len: 1655 microversion: 2.20 time: 0.212074 Feb 17 04:44:19.918424 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 435/876] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:44:19 2021] GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d => generated 1655 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 04:44:19.932213 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.compute.server_external_events [req-1b99048b-ff31-4f5d-b7e8-5789775a5334 req-5347b8bf-8c68-44e5-ab02-2f71f11d61c8 service nova] Creating event network-vif-deleted:84c73f3d-c8e5-45a0-9371-0d806cb29e7b for instance 65811bec-2a80-4c2b-a424-f2a986a6055d on hv-cinder-76019 Feb 17 04:44:19.937799 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [req-1b99048b-ff31-4f5d-b7e8-5789775a5334 req-5347b8bf-8c68-44e5-ab02-2f71f11d61c8 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049605 Feb 17 04:44:19.938518 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 442/877] 10.222.0.38 () {64 vars in 1308 bytes} [Wed Feb 17 04:44:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:44:20.938981 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-0bd0f80d-07dc-4057-82c0-1425e9775582 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:44:20.939676 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-0bd0f80d-07dc-4057-82c0-1425e9775582 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:44:20.947759 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0bd0f80d-07dc-4057-82c0-1425e9775582 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:20.948249 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0bd0f80d-07dc-4057-82c0-1425e9775582 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:20.949340 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0bd0f80d-07dc-4057-82c0-1425e9775582 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:20.950193 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0bd0f80d-07dc-4057-82c0-1425e9775582 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:21.007510 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.wsgi [None req-0bd0f80d-07dc-4057-82c0-1425e9775582 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] HTTP exception thrown: Instance 65811bec-2a80-4c2b-a424-f2a986a6055d could not be found. Feb 17 04:44:21.008182 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-0bd0f80d-07dc-4057-82c0-1425e9775582 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Returning 404 to user: Instance 65811bec-2a80-4c2b-a424-f2a986a6055d could not be found. {{(pid=98080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:44:21.009105 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-0bd0f80d-07dc-4057-82c0-1425e9775582 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d" status: 404 len: 111 microversion: 2.20 time: 0.074482 Feb 17 04:44:21.009734 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 436/878] 10.222.0.38 () {60 vars in 1267 bytes} [Wed Feb 17 04:44:20 2021] GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 17 04:44:21.020592 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-fc496d9d-224a-456d-9dd0-0737bb6f2856 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '.version_select at 0x7fc2e9d5bf28>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:44:21.041019 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-fc496d9d-224a-456d-9dd0-0737bb6f2856 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2123527321" status: 204 len: 0 microversion: 2.20 time: 0.024867 Feb 17 04:44:21.041658 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 443/879] 10.222.0.38 () {60 vars in 1252 bytes} [Wed Feb 17 04:44:21 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2123527321 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Feb 17 04:44:24.560610 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-7b728b20-09de-48cf-946b-69972e79373d tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:44:24.561157 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-7b728b20-09de-48cf-946b-69972e79373d tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:44:24.568989 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7b728b20-09de-48cf-946b-69972e79373d tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:24.569495 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7b728b20-09de-48cf-946b-69972e79373d tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:24.570328 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7b728b20-09de-48cf-946b-69972e79373d tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:24.570843 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7b728b20-09de-48cf-946b-69972e79373d tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:24.626765 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.wsgi [None req-7b728b20-09de-48cf-946b-69972e79373d tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] HTTP exception thrown: Instance 65811bec-2a80-4c2b-a424-f2a986a6055d could not be found. Feb 17 04:44:24.627435 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-7b728b20-09de-48cf-946b-69972e79373d tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Returning 404 to user: Instance 65811bec-2a80-4c2b-a424-f2a986a6055d could not be found. {{(pid=98080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:44:24.628342 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-7b728b20-09de-48cf-946b-69972e79373d tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "DELETE /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d" status: 404 len: 111 microversion: 2.1 time: 0.072131 Feb 17 04:44:24.628960 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 437/880] 10.222.0.38 () {58 vars in 1229 bytes} [Wed Feb 17 04:44:24 2021] DELETE /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:44:24.637399 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-42e44d2c-9db8-4aa3-909f-c19b41083f93 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:44:24.638329 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-42e44d2c-9db8-4aa3-909f-c19b41083f93 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 65811bec-2a80-4c2b-a424-f2a986a6055d] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:44:24.646323 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-42e44d2c-9db8-4aa3-909f-c19b41083f93 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:24.646860 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-42e44d2c-9db8-4aa3-909f-c19b41083f93 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:24.647701 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-42e44d2c-9db8-4aa3-909f-c19b41083f93 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:24.648196 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-42e44d2c-9db8-4aa3-909f-c19b41083f93 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:24.701743 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.wsgi [None req-42e44d2c-9db8-4aa3-909f-c19b41083f93 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] HTTP exception thrown: Instance 65811bec-2a80-4c2b-a424-f2a986a6055d could not be found. Feb 17 04:44:24.702418 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-42e44d2c-9db8-4aa3-909f-c19b41083f93 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Returning 404 to user: Instance 65811bec-2a80-4c2b-a424-f2a986a6055d could not be found. {{(pid=98081) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:44:24.703358 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-42e44d2c-9db8-4aa3-909f-c19b41083f93 tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d" status: 404 len: 111 microversion: 2.1 time: 0.069987 Feb 17 04:44:24.703976 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 444/881] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:44:24 2021] GET /compute/v2.1/servers/65811bec-2a80-4c2b-a424-f2a986a6055d => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:44:25.962438 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-8837dabb-ad09-4134-9776-b446d073b5dc tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:44:25.963122 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-8837dabb-ad09-4134-9776-b446d073b5dc tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:44:25.971621 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8837dabb-ad09-4134-9776-b446d073b5dc tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:25.972121 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8837dabb-ad09-4134-9776-b446d073b5dc tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:25.972948 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8837dabb-ad09-4134-9776-b446d073b5dc tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:25.973439 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8837dabb-ad09-4134-9776-b446d073b5dc tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:26.026611 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.wsgi [None req-8837dabb-ad09-4134-9776-b446d073b5dc tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] HTTP exception thrown: Instance 8d9c77fb-c4b1-4b48-a00a-b85af63c8920 could not be found. Feb 17 04:44:26.027343 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-8837dabb-ad09-4134-9776-b446d073b5dc tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Returning 404 to user: Instance 8d9c77fb-c4b1-4b48-a00a-b85af63c8920 could not be found. {{(pid=98080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:44:26.029462 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-8837dabb-ad09-4134-9776-b446d073b5dc tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "DELETE /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 404 len: 111 microversion: 2.1 time: 0.070032 Feb 17 04:44:26.029462 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 438/882] 10.222.0.38 () {58 vars in 1229 bytes} [Wed Feb 17 04:44:25 2021] DELETE /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:44:26.041502 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-8778fc47-565c-4908-af79-921a217cbc1d tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:44:26.042206 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-8778fc47-565c-4908-af79-921a217cbc1d tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] [instance: 8d9c77fb-c4b1-4b48-a00a-b85af63c8920] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:44:26.054697 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8778fc47-565c-4908-af79-921a217cbc1d tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:26.055665 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8778fc47-565c-4908-af79-921a217cbc1d tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:26.057128 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8778fc47-565c-4908-af79-921a217cbc1d tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:26.058016 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8778fc47-565c-4908-af79-921a217cbc1d tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:26.140926 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.wsgi [None req-8778fc47-565c-4908-af79-921a217cbc1d tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] HTTP exception thrown: Instance 8d9c77fb-c4b1-4b48-a00a-b85af63c8920 could not be found. Feb 17 04:44:26.144634 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-8778fc47-565c-4908-af79-921a217cbc1d tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] Returning 404 to user: Instance 8d9c77fb-c4b1-4b48-a00a-b85af63c8920 could not be found. {{(pid=98081) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:44:26.146144 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-8778fc47-565c-4908-af79-921a217cbc1d tempest-AttachVolumeShelveTestJSON-1295748303 tempest-AttachVolumeShelveTestJSON-1295748303-project] 10.222.0.38 "GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920" status: 404 len: 111 microversion: 2.1 time: 0.111838 Feb 17 04:44:26.147083 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 445/883] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:44:26 2021] GET /compute/v2.1/servers/8d9c77fb-c4b1-4b48-a00a-b85af63c8920 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:44:41.360531 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-31908f30-adbb-4e54-a104-44bc4760f83f tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Action: 'create', calling method: .version_select at 0x7fc2e96bf1e0>, body: {"keypair": {"name": "tempest-keypair-1805510112"}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:44:41.383769 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.quota [None req-31908f30-adbb-4e54-a104-44bc4760f83f tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Getting quotas for project 7dbfc8aedca448fab8273424e08aecf0. Resources: {'key_pairs'} {{(pid=98080) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:44:41.388542 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.quota [None req-31908f30-adbb-4e54-a104-44bc4760f83f tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Getting quotas for user 1d8b4cda0b044342ba470c32b33d0a14 and project 7dbfc8aedca448fab8273424e08aecf0. Resources: {'key_pairs'} {{(pid=98080) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:44:41.672571 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.quota [None req-31908f30-adbb-4e54-a104-44bc4760f83f tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Getting quotas for project 7dbfc8aedca448fab8273424e08aecf0. Resources: {'key_pairs'} {{(pid=98080) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:44:41.676527 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.quota [None req-31908f30-adbb-4e54-a104-44bc4760f83f tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Getting quotas for user 1d8b4cda0b044342ba470c32b33d0a14 and project 7dbfc8aedca448fab8273424e08aecf0. Resources: {'key_pairs'} {{(pid=98080) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:44:41.691262 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-31908f30-adbb-4e54-a104-44bc4760f83f tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.458764 Feb 17 04:44:41.691920 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 439/884] 10.222.0.38 () {60 vars in 1148 bytes} [Wed Feb 17 04:44:41 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:44:44.140043 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-c628148c-5f9b-49e6-8f8b-2115b7c3f0a7 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1724844636", "imageRef": "2d6991a7-a1f0-444b-8fd5-d05558b5f9a4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "31fedee6-4f2b-4144-ad68-a6683410778d"}], "security_groups": [{"name": "tempest-securitygroup--791947950"}], "key_name": "tempest-keypair-1805510112", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:44:44.273885 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.network.neutron [None req-c628148c-5f9b-49e6-8f8b-2115b7c3f0a7 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] validate_networks() for [('31fedee6-4f2b-4144-ad68-a6683410778d', None, None, None)] {{(pid=98081) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 04:44:44.879232 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-c628148c-5f9b-49e6-8f8b-2115b7c3f0a7 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Flavor limits 0:0:0 {{(pid=98081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 04:44:44.879715 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-c628148c-5f9b-49e6-8f8b-2115b7c3f0a7 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Image limits 0:0:0 {{(pid=98081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 04:44:44.880350 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-c628148c-5f9b-49e6-8f8b-2115b7c3f0a7 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Flavor pref 0:0:0 {{(pid=98081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 04:44:44.880773 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-c628148c-5f9b-49e6-8f8b-2115b7c3f0a7 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Image pref 0:0:0 {{(pid=98081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 04:44:44.881241 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-c628148c-5f9b-49e6-8f8b-2115b7c3f0a7 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 04:44:44.892616 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c628148c-5f9b-49e6-8f8b-2115b7c3f0a7 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:44.893127 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c628148c-5f9b-49e6-8f8b-2115b7c3f0a7 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:44.894125 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c628148c-5f9b-49e6-8f8b-2115b7c3f0a7 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:44.894638 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c628148c-5f9b-49e6-8f8b-2115b7c3f0a7 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:44.918045 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.quota [None req-c628148c-5f9b-49e6-8f8b-2115b7c3f0a7 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Getting quotas for project 7dbfc8aedca448fab8273424e08aecf0. Resources: {'instances', 'cores', 'ram'} {{(pid=98081) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:44:44.923079 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.quota [None req-c628148c-5f9b-49e6-8f8b-2115b7c3f0a7 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Getting quotas for user 1d8b4cda0b044342ba470c32b33d0a14 and project 7dbfc8aedca448fab8273424e08aecf0. Resources: {'instances', 'cores', 'ram'} {{(pid=98081) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:44:44.935105 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-c628148c-5f9b-49e6-8f8b-2115b7c3f0a7 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Going to run 1 instances... {{(pid=98081) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 04:44:44.937760 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-c628148c-5f9b-49e6-8f8b-2115b7c3f0a7 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: 486ab1d3-d971-40c2-aca6-4ce6ef472355] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d6991a7-a1f0-444b-8fd5-d05558b5f9a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98081) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 04:44:44.991142 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-c628148c-5f9b-49e6-8f8b-2115b7c3f0a7 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.855965 Feb 17 04:44:44.991773 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 446/885] 10.222.0.38 () {60 vars in 1137 bytes} [Wed Feb 17 04:44:44 2021] POST /compute/v2.1/servers => generated 401 bytes in 857 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 17 04:44:45.003320 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-c0d51bad-3540-43bf-9d21-b4ca079e8a87 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:44:45.003900 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-c0d51bad-3540-43bf-9d21-b4ca079e8a87 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: 486ab1d3-d971-40c2-aca6-4ce6ef472355] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:44:45.084665 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-c0d51bad-3540-43bf-9d21-b4ca079e8a87 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8b4cda0b044342ba470c32b33d0a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbfc8aedca448fab8273424e08aecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:44:45.096365 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-c0d51bad-3540-43bf-9d21-b4ca079e8a87 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "GET /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355" status: 200 len: 1238 microversion: 2.1 time: 0.097006 Feb 17 04:44:45.097160 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 440/886] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:44:44 2021] GET /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355 => generated 1238 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:44:46.115444 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-0398f6a5-4b32-42ec-a9b5-ff4c461a8e24 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:44:46.116118 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-0398f6a5-4b32-42ec-a9b5-ff4c461a8e24 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: 486ab1d3-d971-40c2-aca6-4ce6ef472355] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:44:46.124406 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0398f6a5-4b32-42ec-a9b5-ff4c461a8e24 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:46.124919 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0398f6a5-4b32-42ec-a9b5-ff4c461a8e24 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:46.125781 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0398f6a5-4b32-42ec-a9b5-ff4c461a8e24 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:46.126285 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0398f6a5-4b32-42ec-a9b5-ff4c461a8e24 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:46.270164 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-0398f6a5-4b32-42ec-a9b5-ff4c461a8e24 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8b4cda0b044342ba470c32b33d0a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbfc8aedca448fab8273424e08aecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:44:46.284182 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-0398f6a5-4b32-42ec-a9b5-ff4c461a8e24 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "GET /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355" status: 200 len: 1308 microversion: 2.1 time: 0.172426 Feb 17 04:44:46.284792 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 447/887] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:44:46 2021] GET /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355 => generated 1308 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:44:47.302890 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-60e94ff4-4686-49f3-808c-f78dbdce947c tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:44:47.303572 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-60e94ff4-4686-49f3-808c-f78dbdce947c tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: 486ab1d3-d971-40c2-aca6-4ce6ef472355] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:44:47.319912 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-60e94ff4-4686-49f3-808c-f78dbdce947c tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:47.320436 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-60e94ff4-4686-49f3-808c-f78dbdce947c tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:47.321306 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-60e94ff4-4686-49f3-808c-f78dbdce947c tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:47.321790 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-60e94ff4-4686-49f3-808c-f78dbdce947c tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:47.756519 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-60e94ff4-4686-49f3-808c-f78dbdce947c tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8b4cda0b044342ba470c32b33d0a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbfc8aedca448fab8273424e08aecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:44:47.766747 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-60e94ff4-4686-49f3-808c-f78dbdce947c tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "GET /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355" status: 200 len: 1363 microversion: 2.1 time: 0.467928 Feb 17 04:44:47.767847 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 441/888] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:44:47 2021] GET /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355 => generated 1363 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:44:48.786134 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-7ec4acc8-ff74-4455-871d-5c66574f6bf3 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:44:48.786838 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-7ec4acc8-ff74-4455-871d-5c66574f6bf3 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: 486ab1d3-d971-40c2-aca6-4ce6ef472355] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:44:48.795557 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7ec4acc8-ff74-4455-871d-5c66574f6bf3 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:48.796066 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7ec4acc8-ff74-4455-871d-5c66574f6bf3 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:48.796927 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7ec4acc8-ff74-4455-871d-5c66574f6bf3 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:48.797421 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7ec4acc8-ff74-4455-871d-5c66574f6bf3 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:49.228595 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [req-15be9cf9-bcdd-47f1-b53f-d65b93493405 req-52f4eab3-9f49-4194-a763-aa0f769bb3ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "486ab1d3-d971-40c2-aca6-4ce6ef472355", "tag": "49a28669-ba0f-4ebc-9e11-2ac8f664d4d4"}]} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:44:49.230616 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:44:49.230616 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:44:49.241082 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-15be9cf9-bcdd-47f1-b53f-d65b93493405 req-52f4eab3-9f49-4194-a763-aa0f769bb3ef service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:49.241733 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-15be9cf9-bcdd-47f1-b53f-d65b93493405 req-52f4eab3-9f49-4194-a763-aa0f769bb3ef service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:49.266210 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.compute.server_external_events [req-15be9cf9-bcdd-47f1-b53f-d65b93493405 req-52f4eab3-9f49-4194-a763-aa0f769bb3ef service nova] Creating event network-changed:49a28669-ba0f-4ebc-9e11-2ac8f664d4d4 for instance 486ab1d3-d971-40c2-aca6-4ce6ef472355 on hv-cinder-76019 Feb 17 04:44:49.273186 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [req-15be9cf9-bcdd-47f1-b53f-d65b93493405 req-52f4eab3-9f49-4194-a763-aa0f769bb3ef service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048181 Feb 17 04:44:49.273962 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 442/889] 10.222.0.38 () {64 vars in 1308 bytes} [Wed Feb 17 04:44:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:44:49.320595 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-7ec4acc8-ff74-4455-871d-5c66574f6bf3 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8b4cda0b044342ba470c32b33d0a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbfc8aedca448fab8273424e08aecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:44:49.331632 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-7ec4acc8-ff74-4455-871d-5c66574f6bf3 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "GET /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355" status: 200 len: 1363 microversion: 2.1 time: 0.549549 Feb 17 04:44:49.332674 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 448/890] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:44:48 2021] GET /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355 => generated 1363 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:44:50.352016 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-c1c8df66-8513-4881-be61-c543c594e3e6 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:44:50.352819 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-c1c8df66-8513-4881-be61-c543c594e3e6 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: 486ab1d3-d971-40c2-aca6-4ce6ef472355] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:44:50.361598 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c1c8df66-8513-4881-be61-c543c594e3e6 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:50.362118 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c1c8df66-8513-4881-be61-c543c594e3e6 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:50.363023 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c1c8df66-8513-4881-be61-c543c594e3e6 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:50.363524 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c1c8df66-8513-4881-be61-c543c594e3e6 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:50.789274 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-c1c8df66-8513-4881-be61-c543c594e3e6 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8b4cda0b044342ba470c32b33d0a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbfc8aedca448fab8273424e08aecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:44:50.798723 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-c1c8df66-8513-4881-be61-c543c594e3e6 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "GET /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355" status: 200 len: 1363 microversion: 2.1 time: 0.451144 Feb 17 04:44:50.799335 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 443/891] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:44:50 2021] GET /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355 => generated 1363 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:44:51.821660 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-5a0a3b1c-156c-4116-8e43-5bdbe0109b58 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:44:51.822329 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-5a0a3b1c-156c-4116-8e43-5bdbe0109b58 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: 486ab1d3-d971-40c2-aca6-4ce6ef472355] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:44:51.830269 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5a0a3b1c-156c-4116-8e43-5bdbe0109b58 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:51.830819 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5a0a3b1c-156c-4116-8e43-5bdbe0109b58 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:51.831663 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5a0a3b1c-156c-4116-8e43-5bdbe0109b58 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:51.832161 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5a0a3b1c-156c-4116-8e43-5bdbe0109b58 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:52.062646 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-5a0a3b1c-156c-4116-8e43-5bdbe0109b58 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8b4cda0b044342ba470c32b33d0a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbfc8aedca448fab8273424e08aecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:44:52.072019 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-5a0a3b1c-156c-4116-8e43-5bdbe0109b58 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "GET /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355" status: 200 len: 1363 microversion: 2.1 time: 0.254244 Feb 17 04:44:52.072570 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 449/892] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:44:51 2021] GET /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355 => generated 1363 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:44:52.333882 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [req-378d9fa0-6045-4600-89e6-a567c31499b0 req-e86cd0d6-7a59-43b8-b59e-de2f21d3657f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "486ab1d3-d971-40c2-aca6-4ce6ef472355", "name": "network-vif-plugged", "status": "completed", "tag": "49a28669-ba0f-4ebc-9e11-2ac8f664d4d4"}]} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:44:52.335658 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:44:52.335658 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:44:52.345502 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-378d9fa0-6045-4600-89e6-a567c31499b0 req-e86cd0d6-7a59-43b8-b59e-de2f21d3657f service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:52.346020 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-378d9fa0-6045-4600-89e6-a567c31499b0 req-e86cd0d6-7a59-43b8-b59e-de2f21d3657f service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:52.364196 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.compute.server_external_events [req-378d9fa0-6045-4600-89e6-a567c31499b0 req-e86cd0d6-7a59-43b8-b59e-de2f21d3657f service nova] Creating event network-vif-plugged:49a28669-ba0f-4ebc-9e11-2ac8f664d4d4 for instance 486ab1d3-d971-40c2-aca6-4ce6ef472355 on hv-cinder-76019 Feb 17 04:44:52.370016 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [req-378d9fa0-6045-4600-89e6-a567c31499b0 req-e86cd0d6-7a59-43b8-b59e-de2f21d3657f service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039748 Feb 17 04:44:52.370338 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 444/893] 10.222.0.38 () {64 vars in 1308 bytes} [Wed Feb 17 04:44:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:44:53.089540 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-072be448-041c-4c78-88d2-c73778ecf592 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:44:53.090728 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-072be448-041c-4c78-88d2-c73778ecf592 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: 486ab1d3-d971-40c2-aca6-4ce6ef472355] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:44:53.098698 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-072be448-041c-4c78-88d2-c73778ecf592 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:53.099200 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-072be448-041c-4c78-88d2-c73778ecf592 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:53.100032 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-072be448-041c-4c78-88d2-c73778ecf592 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:53.100544 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-072be448-041c-4c78-88d2-c73778ecf592 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:53.309447 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-072be448-041c-4c78-88d2-c73778ecf592 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8b4cda0b044342ba470c32b33d0a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbfc8aedca448fab8273424e08aecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:44:53.318220 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-072be448-041c-4c78-88d2-c73778ecf592 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "GET /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355" status: 200 len: 1363 microversion: 2.1 time: 0.232691 Feb 17 04:44:53.318848 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 450/894] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:44:53 2021] GET /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355 => generated 1363 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:44:54.337677 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-9e34079b-389a-41d7-aed4-3cacfa80c111 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:44:54.338496 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-9e34079b-389a-41d7-aed4-3cacfa80c111 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: 486ab1d3-d971-40c2-aca6-4ce6ef472355] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:44:54.346659 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9e34079b-389a-41d7-aed4-3cacfa80c111 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:54.347185 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9e34079b-389a-41d7-aed4-3cacfa80c111 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:54.348032 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9e34079b-389a-41d7-aed4-3cacfa80c111 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:54.348534 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9e34079b-389a-41d7-aed4-3cacfa80c111 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:54.561649 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-9e34079b-389a-41d7-aed4-3cacfa80c111 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8b4cda0b044342ba470c32b33d0a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbfc8aedca448fab8273424e08aecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:44:54.570518 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-9e34079b-389a-41d7-aed4-3cacfa80c111 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "GET /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355" status: 200 len: 1549 microversion: 2.1 time: 0.237398 Feb 17 04:44:54.571145 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 445/895] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:44:54 2021] GET /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355 => generated 1549 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:44:54.588127 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-dbd5b018-81bc-4102-8e6a-955c4b8f50e1 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:44:54.588614 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-dbd5b018-81bc-4102-8e6a-955c4b8f50e1 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: 486ab1d3-d971-40c2-aca6-4ce6ef472355] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:44:54.597224 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-dbd5b018-81bc-4102-8e6a-955c4b8f50e1 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:54.597729 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-dbd5b018-81bc-4102-8e6a-955c4b8f50e1 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:54.598593 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-dbd5b018-81bc-4102-8e6a-955c4b8f50e1 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:54.599090 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-dbd5b018-81bc-4102-8e6a-955c4b8f50e1 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:54.754852 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-dbd5b018-81bc-4102-8e6a-955c4b8f50e1 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "GET /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.170600 Feb 17 04:44:54.755551 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 451/896] 10.222.0.38 () {58 vars in 1265 bytes} [Wed Feb 17 04:44:54 2021] GET /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355/os-interface => generated 284 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:44:56.546452 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-f6662073-a0dd-4da2-999d-351c03a71aed tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:44:56.547571 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-f6662073-a0dd-4da2-999d-351c03a71aed tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: 486ab1d3-d971-40c2-aca6-4ce6ef472355] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:44:56.555784 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [req-f83785f8-8553-43d7-bbc0-0b67a341ccf1 req-eeb3f9cb-c6dd-4be3-8c6d-a7e523c878be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "486ab1d3-d971-40c2-aca6-4ce6ef472355", "tag": "49a28669-ba0f-4ebc-9e11-2ac8f664d4d4"}]} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:44:56.557578 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:44:56.557578 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:44:56.567972 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f6662073-a0dd-4da2-999d-351c03a71aed tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:56.568492 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f6662073-a0dd-4da2-999d-351c03a71aed tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:56.568608 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-f83785f8-8553-43d7-bbc0-0b67a341ccf1 req-eeb3f9cb-c6dd-4be3-8c6d-a7e523c878be service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:56.569012 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-f83785f8-8553-43d7-bbc0-0b67a341ccf1 req-eeb3f9cb-c6dd-4be3-8c6d-a7e523c878be service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:56.569352 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f6662073-a0dd-4da2-999d-351c03a71aed tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:56.569848 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f6662073-a0dd-4da2-999d-351c03a71aed tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:56.587250 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.compute.server_external_events [req-f83785f8-8553-43d7-bbc0-0b67a341ccf1 req-eeb3f9cb-c6dd-4be3-8c6d-a7e523c878be service nova] Creating event network-changed:49a28669-ba0f-4ebc-9e11-2ac8f664d4d4 for instance 486ab1d3-d971-40c2-aca6-4ce6ef472355 on hv-cinder-76019 Feb 17 04:44:56.593527 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [req-f83785f8-8553-43d7-bbc0-0b67a341ccf1 req-eeb3f9cb-c6dd-4be3-8c6d-a7e523c878be service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041577 Feb 17 04:44:56.594553 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 452/897] 10.222.0.38 () {64 vars in 1308 bytes} [Wed Feb 17 04:44:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:44:56.669214 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-f6662073-a0dd-4da2-999d-351c03a71aed tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "POST /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355/action" status: 200 len: 14 microversion: 2.1 time: 0.126696 Feb 17 04:44:56.673034 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 446/898] 10.222.0.38 () {60 vars in 1268 bytes} [Wed Feb 17 04:44:56 2021] POST /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355/action => generated 14 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:44:57.681433 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-f13286dc-2f8e-419e-a26e-ecb99247d914 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:44:57.682548 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-f13286dc-2f8e-419e-a26e-ecb99247d914 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: 486ab1d3-d971-40c2-aca6-4ce6ef472355] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:44:57.691187 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f13286dc-2f8e-419e-a26e-ecb99247d914 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:57.691701 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f13286dc-2f8e-419e-a26e-ecb99247d914 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:57.692548 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f13286dc-2f8e-419e-a26e-ecb99247d914 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:57.693049 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f13286dc-2f8e-419e-a26e-ecb99247d914 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:57.792858 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-f13286dc-2f8e-419e-a26e-ecb99247d914 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "POST /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355/action" status: 200 len: 14 microversion: 2.1 time: 0.115791 Feb 17 04:44:57.793574 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 453/899] 10.222.0.38 () {60 vars in 1268 bytes} [Wed Feb 17 04:44:57 2021] POST /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355/action => generated 14 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:44:58.805723 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-0695e193-25bc-4616-aac6-c141637a0798 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:44:58.806894 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-0695e193-25bc-4616-aac6-c141637a0798 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: 486ab1d3-d971-40c2-aca6-4ce6ef472355] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:44:58.816129 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0695e193-25bc-4616-aac6-c141637a0798 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:58.816645 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0695e193-25bc-4616-aac6-c141637a0798 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:58.817496 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0695e193-25bc-4616-aac6-c141637a0798 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:58.818055 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0695e193-25bc-4616-aac6-c141637a0798 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:58.916246 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-0695e193-25bc-4616-aac6-c141637a0798 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "POST /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355/action" status: 200 len: 14 microversion: 2.1 time: 0.114892 Feb 17 04:44:58.916919 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 447/900] 10.222.0.38 () {60 vars in 1268 bytes} [Wed Feb 17 04:44:58 2021] POST /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355/action => generated 14 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:44:59.935054 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-220564f6-5b1a-4981-a0f6-ccef29f4134a tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:44:59.936192 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-220564f6-5b1a-4981-a0f6-ccef29f4134a tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: 486ab1d3-d971-40c2-aca6-4ce6ef472355] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:44:59.944794 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-220564f6-5b1a-4981-a0f6-ccef29f4134a tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:59.945309 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-220564f6-5b1a-4981-a0f6-ccef29f4134a tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:44:59.946157 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-220564f6-5b1a-4981-a0f6-ccef29f4134a tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:44:59.946689 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-220564f6-5b1a-4981-a0f6-ccef29f4134a tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:00.044438 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-220564f6-5b1a-4981-a0f6-ccef29f4134a tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "POST /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355/action" status: 200 len: 14 microversion: 2.1 time: 0.114461 Feb 17 04:45:00.045100 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 454/901] 10.222.0.38 () {60 vars in 1268 bytes} [Wed Feb 17 04:44:59 2021] POST /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355/action => generated 14 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:45:01.056742 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-2f786a56-233d-4656-8694-c6782773bc65 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:45:01.057872 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-2f786a56-233d-4656-8694-c6782773bc65 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: 486ab1d3-d971-40c2-aca6-4ce6ef472355] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:45:01.066769 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2f786a56-233d-4656-8694-c6782773bc65 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:01.067282 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2f786a56-233d-4656-8694-c6782773bc65 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:01.068120 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2f786a56-233d-4656-8694-c6782773bc65 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:01.068612 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2f786a56-233d-4656-8694-c6782773bc65 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:01.161789 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-2f786a56-233d-4656-8694-c6782773bc65 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "POST /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355/action" status: 200 len: 14 microversion: 2.1 time: 0.109220 Feb 17 04:45:01.162470 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 448/902] 10.222.0.38 () {60 vars in 1268 bytes} [Wed Feb 17 04:45:01 2021] POST /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355/action => generated 14 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:45:02.174979 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-bac7d463-7b02-491c-b4f0-8bbd8e6fe655 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:45:02.176119 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-bac7d463-7b02-491c-b4f0-8bbd8e6fe655 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: 486ab1d3-d971-40c2-aca6-4ce6ef472355] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:45:02.185047 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-bac7d463-7b02-491c-b4f0-8bbd8e6fe655 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:02.185558 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-bac7d463-7b02-491c-b4f0-8bbd8e6fe655 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:02.186399 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-bac7d463-7b02-491c-b4f0-8bbd8e6fe655 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:02.186950 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-bac7d463-7b02-491c-b4f0-8bbd8e6fe655 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:02.280639 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-bac7d463-7b02-491c-b4f0-8bbd8e6fe655 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "POST /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355/action" status: 200 len: 14 microversion: 2.1 time: 0.110089 Feb 17 04:45:02.281231 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 455/903] 10.222.0.38 () {60 vars in 1268 bytes} [Wed Feb 17 04:45:02 2021] POST /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355/action => generated 14 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:45:03.293656 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-57da0ed6-c0e1-4575-9f73-6b1494878bd3 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:45:03.294871 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-57da0ed6-c0e1-4575-9f73-6b1494878bd3 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: 486ab1d3-d971-40c2-aca6-4ce6ef472355] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:45:03.303374 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-57da0ed6-c0e1-4575-9f73-6b1494878bd3 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:03.303885 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-57da0ed6-c0e1-4575-9f73-6b1494878bd3 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:03.304774 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-57da0ed6-c0e1-4575-9f73-6b1494878bd3 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:03.305271 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-57da0ed6-c0e1-4575-9f73-6b1494878bd3 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:03.407907 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-57da0ed6-c0e1-4575-9f73-6b1494878bd3 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "POST /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355/action" status: 200 len: 14 microversion: 2.1 time: 0.119350 Feb 17 04:45:03.408610 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 449/904] 10.222.0.38 () {60 vars in 1268 bytes} [Wed Feb 17 04:45:03 2021] POST /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355/action => generated 14 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:45:04.420752 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-b2a26539-63a5-4223-8170-1fef70458b03 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:45:04.421931 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-b2a26539-63a5-4223-8170-1fef70458b03 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: 486ab1d3-d971-40c2-aca6-4ce6ef472355] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:45:04.430510 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b2a26539-63a5-4223-8170-1fef70458b03 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:04.431069 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b2a26539-63a5-4223-8170-1fef70458b03 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:04.431910 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b2a26539-63a5-4223-8170-1fef70458b03 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:04.432405 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b2a26539-63a5-4223-8170-1fef70458b03 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:04.531158 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-b2a26539-63a5-4223-8170-1fef70458b03 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "POST /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355/action" status: 200 len: 14 microversion: 2.1 time: 0.114957 Feb 17 04:45:04.531835 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 456/905] 10.222.0.38 () {60 vars in 1268 bytes} [Wed Feb 17 04:45:04 2021] POST /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355/action => generated 14 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:45:05.543875 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-658aaa5b-9d5c-45ee-816d-35218a74daa4 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:45:05.544990 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-658aaa5b-9d5c-45ee-816d-35218a74daa4 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: 486ab1d3-d971-40c2-aca6-4ce6ef472355] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:45:05.553478 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-658aaa5b-9d5c-45ee-816d-35218a74daa4 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:05.553985 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-658aaa5b-9d5c-45ee-816d-35218a74daa4 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:05.554849 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-658aaa5b-9d5c-45ee-816d-35218a74daa4 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:05.555348 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-658aaa5b-9d5c-45ee-816d-35218a74daa4 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:05.667177 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-658aaa5b-9d5c-45ee-816d-35218a74daa4 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "POST /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355/action" status: 200 len: 2778 microversion: 2.1 time: 0.127670 Feb 17 04:45:05.668041 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 450/906] 10.222.0.38 () {60 vars in 1268 bytes} [Wed Feb 17 04:45:05 2021] POST /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355/action => generated 2778 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:45:06.680038 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-716be7bf-9066-402b-9885-95bf01365c6c tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:45:06.681240 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-716be7bf-9066-402b-9885-95bf01365c6c tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: 486ab1d3-d971-40c2-aca6-4ce6ef472355] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:45:06.690688 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-716be7bf-9066-402b-9885-95bf01365c6c tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:06.691212 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-716be7bf-9066-402b-9885-95bf01365c6c tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:06.692061 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-716be7bf-9066-402b-9885-95bf01365c6c tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:06.692565 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-716be7bf-9066-402b-9885-95bf01365c6c tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:06.803996 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-716be7bf-9066-402b-9885-95bf01365c6c tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "POST /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355/action" status: 200 len: 15025 microversion: 2.1 time: 0.128346 Feb 17 04:45:06.804679 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 457/907] 10.222.0.38 () {60 vars in 1268 bytes} [Wed Feb 17 04:45:06 2021] POST /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355/action => generated 15025 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:45:07.816827 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-6de0d8c3-1882-4a92-8eec-83cff3ca3736 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:45:07.818023 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-6de0d8c3-1882-4a92-8eec-83cff3ca3736 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: 486ab1d3-d971-40c2-aca6-4ce6ef472355] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:45:07.827296 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6de0d8c3-1882-4a92-8eec-83cff3ca3736 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:07.827803 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6de0d8c3-1882-4a92-8eec-83cff3ca3736 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:07.828632 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6de0d8c3-1882-4a92-8eec-83cff3ca3736 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:07.829121 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6de0d8c3-1882-4a92-8eec-83cff3ca3736 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:07.941666 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-6de0d8c3-1882-4a92-8eec-83cff3ca3736 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "POST /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355/action" status: 200 len: 18561 microversion: 2.1 time: 0.129118 Feb 17 04:45:07.942377 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 451/908] 10.222.0.38 () {60 vars in 1268 bytes} [Wed Feb 17 04:45:07 2021] POST /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355/action => generated 18561 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:45:08.955409 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-4c619df2-517b-4c1a-ae6b-0edf4602f19e tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:45:08.956557 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-4c619df2-517b-4c1a-ae6b-0edf4602f19e tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: 486ab1d3-d971-40c2-aca6-4ce6ef472355] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:45:08.965468 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4c619df2-517b-4c1a-ae6b-0edf4602f19e tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:08.965976 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4c619df2-517b-4c1a-ae6b-0edf4602f19e tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:08.966884 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4c619df2-517b-4c1a-ae6b-0edf4602f19e tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:08.967384 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4c619df2-517b-4c1a-ae6b-0edf4602f19e tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:09.079172 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-4c619df2-517b-4c1a-ae6b-0edf4602f19e tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "POST /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355/action" status: 200 len: 19601 microversion: 2.1 time: 0.128703 Feb 17 04:45:09.080076 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 458/909] 10.222.0.38 () {60 vars in 1268 bytes} [Wed Feb 17 04:45:08 2021] POST /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355/action => generated 19601 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:45:10.093088 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-3ea3afcc-0107-4af7-a3b2-2cd046998d24 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:45:10.094223 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-3ea3afcc-0107-4af7-a3b2-2cd046998d24 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: 486ab1d3-d971-40c2-aca6-4ce6ef472355] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:45:10.103252 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-3ea3afcc-0107-4af7-a3b2-2cd046998d24 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:10.104002 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-3ea3afcc-0107-4af7-a3b2-2cd046998d24 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:10.104888 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-3ea3afcc-0107-4af7-a3b2-2cd046998d24 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:10.105577 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-3ea3afcc-0107-4af7-a3b2-2cd046998d24 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:10.216512 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-3ea3afcc-0107-4af7-a3b2-2cd046998d24 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "POST /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355/action" status: 200 len: 22716 microversion: 2.1 time: 0.128740 Feb 17 04:45:10.217425 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 452/910] 10.222.0.38 () {60 vars in 1268 bytes} [Wed Feb 17 04:45:10 2021] POST /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355/action => generated 22716 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:45:11.229328 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-8b0ab983-e089-4643-bf1a-19699ae7c617 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:45:11.231199 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-8b0ab983-e089-4643-bf1a-19699ae7c617 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: 486ab1d3-d971-40c2-aca6-4ce6ef472355] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:45:11.239996 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8b0ab983-e089-4643-bf1a-19699ae7c617 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:11.240538 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8b0ab983-e089-4643-bf1a-19699ae7c617 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:11.241411 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8b0ab983-e089-4643-bf1a-19699ae7c617 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:11.241886 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8b0ab983-e089-4643-bf1a-19699ae7c617 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:11.354762 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-8b0ab983-e089-4643-bf1a-19699ae7c617 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "POST /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355/action" status: 200 len: 23804 microversion: 2.1 time: 0.129812 Feb 17 04:45:11.356121 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 459/911] 10.222.0.38 () {60 vars in 1268 bytes} [Wed Feb 17 04:45:11 2021] POST /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355/action => generated 23804 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:45:12.368375 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-c4884771-d0a5-4087-b36b-7156b74051c1 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:45:12.369544 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-c4884771-d0a5-4087-b36b-7156b74051c1 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: 486ab1d3-d971-40c2-aca6-4ce6ef472355] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:45:12.378026 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c4884771-d0a5-4087-b36b-7156b74051c1 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:12.378530 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c4884771-d0a5-4087-b36b-7156b74051c1 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:12.379449 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c4884771-d0a5-4087-b36b-7156b74051c1 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:12.379939 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c4884771-d0a5-4087-b36b-7156b74051c1 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:12.491779 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-c4884771-d0a5-4087-b36b-7156b74051c1 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "POST /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355/action" status: 200 len: 25667 microversion: 2.1 time: 0.127688 Feb 17 04:45:12.492465 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 453/912] 10.222.0.38 () {60 vars in 1268 bytes} [Wed Feb 17 04:45:12 2021] POST /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355/action => generated 25667 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:45:12.565329 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-2f2abbe9-70ec-43f4-9a73-d50c291db809 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:45:12.566026 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-2f2abbe9-70ec-43f4-9a73-d50c291db809 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] [instance: e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:45:12.575422 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2f2abbe9-70ec-43f4-9a73-d50c291db809 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:12.575945 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2f2abbe9-70ec-43f4-9a73-d50c291db809 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:12.576790 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2f2abbe9-70ec-43f4-9a73-d50c291db809 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:12.577293 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2f2abbe9-70ec-43f4-9a73-d50c291db809 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:12.637847 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.objects.instance [None req-2f2abbe9-70ec-43f4-9a73-d50c291db809 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lazy-loading 'flavor' on Instance uuid e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2 {{(pid=98081) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:45:12.780837 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-2f2abbe9-70ec-43f4-9a73-d50c291db809 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] 10.222.0.38 "POST /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2/action" status: 202 len: 0 microversion: 2.1 time: 0.219954 Feb 17 04:45:12.781574 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 460/913] 10.222.0.38 () {60 vars in 1268 bytes} [Wed Feb 17 04:45:12 2021] POST /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2/action => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:45:12.790989 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-72055b43-053f-4c4a-904d-a8492bbd720c tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:45:12.791764 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-72055b43-053f-4c4a-904d-a8492bbd720c tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] [instance: e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:45:12.800860 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-72055b43-053f-4c4a-904d-a8492bbd720c tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:12.801373 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-72055b43-053f-4c4a-904d-a8492bbd720c tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:12.802279 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-72055b43-053f-4c4a-904d-a8492bbd720c tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:12.802883 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-72055b43-053f-4c4a-904d-a8492bbd720c tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:13.017398 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-72055b43-053f-4c4a-904d-a8492bbd720c tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cd0aa08bfc4637a988f25eec8cfb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca59cfbe7f3b494499cc8efe1d0e093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:45:13.026366 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-72055b43-053f-4c4a-904d-a8492bbd720c tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] 10.222.0.38 "GET /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2" status: 200 len: 1573 microversion: 2.1 time: 0.239951 Feb 17 04:45:13.027635 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 454/914] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:45:12 2021] GET /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2 => generated 1573 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:45:13.505399 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-cd15b188-07ac-4367-bc4c-8e6bed640f87 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:45:13.506531 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-cd15b188-07ac-4367-bc4c-8e6bed640f87 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: 486ab1d3-d971-40c2-aca6-4ce6ef472355] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:45:13.515541 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-cd15b188-07ac-4367-bc4c-8e6bed640f87 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:13.516057 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-cd15b188-07ac-4367-bc4c-8e6bed640f87 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:13.516905 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-cd15b188-07ac-4367-bc4c-8e6bed640f87 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:13.517404 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-cd15b188-07ac-4367-bc4c-8e6bed640f87 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:13.635858 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-cd15b188-07ac-4367-bc4c-8e6bed640f87 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "POST /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355/action" status: 200 len: 27000 microversion: 2.1 time: 0.134827 Feb 17 04:45:13.637087 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 461/915] 10.222.0.38 () {60 vars in 1268 bytes} [Wed Feb 17 04:45:13 2021] POST /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355/action => generated 27000 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:45:14.046024 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-6970bd9f-10e5-4c85-a15d-9a3cc9823aef tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:45:14.046731 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-6970bd9f-10e5-4c85-a15d-9a3cc9823aef tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] [instance: e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:45:14.055389 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6970bd9f-10e5-4c85-a15d-9a3cc9823aef tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:14.055920 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6970bd9f-10e5-4c85-a15d-9a3cc9823aef tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:14.056772 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6970bd9f-10e5-4c85-a15d-9a3cc9823aef tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:14.057264 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6970bd9f-10e5-4c85-a15d-9a3cc9823aef tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:14.272347 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-6970bd9f-10e5-4c85-a15d-9a3cc9823aef tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cd0aa08bfc4637a988f25eec8cfb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca59cfbe7f3b494499cc8efe1d0e093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:45:14.281579 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-6970bd9f-10e5-4c85-a15d-9a3cc9823aef tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] 10.222.0.38 "GET /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2" status: 200 len: 1573 microversion: 2.1 time: 0.239942 Feb 17 04:45:14.282188 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 455/916] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:45:14 2021] GET /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2 => generated 1573 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:45:14.649609 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-bd777fb9-eb8f-46c1-80e9-3f7ce59022b7 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:45:14.650823 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-bd777fb9-eb8f-46c1-80e9-3f7ce59022b7 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: 486ab1d3-d971-40c2-aca6-4ce6ef472355] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:45:14.660060 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-bd777fb9-eb8f-46c1-80e9-3f7ce59022b7 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:14.660602 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-bd777fb9-eb8f-46c1-80e9-3f7ce59022b7 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:14.661416 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-bd777fb9-eb8f-46c1-80e9-3f7ce59022b7 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:14.661917 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-bd777fb9-eb8f-46c1-80e9-3f7ce59022b7 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:14.775489 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-bd777fb9-eb8f-46c1-80e9-3f7ce59022b7 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "POST /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355/action" status: 200 len: 27790 microversion: 2.1 time: 0.130349 Feb 17 04:45:14.776438 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 462/917] 10.222.0.38 () {60 vars in 1268 bytes} [Wed Feb 17 04:45:14 2021] POST /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355/action => generated 27790 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:45:15.300179 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-c7a30b61-b7df-4272-a00c-03978668061d tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:45:15.300838 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-c7a30b61-b7df-4272-a00c-03978668061d tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] [instance: e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:45:15.309782 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c7a30b61-b7df-4272-a00c-03978668061d tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:15.310292 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c7a30b61-b7df-4272-a00c-03978668061d tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:15.311147 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c7a30b61-b7df-4272-a00c-03978668061d tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:15.311637 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c7a30b61-b7df-4272-a00c-03978668061d tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:15.521304 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-c7a30b61-b7df-4272-a00c-03978668061d tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cd0aa08bfc4637a988f25eec8cfb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca59cfbe7f3b494499cc8efe1d0e093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:45:15.531184 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-c7a30b61-b7df-4272-a00c-03978668061d tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] 10.222.0.38 "GET /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2" status: 200 len: 1573 microversion: 2.1 time: 0.235024 Feb 17 04:45:15.531800 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 456/918] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:45:15 2021] GET /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2 => generated 1573 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:45:15.789118 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-d0b3a6a3-e259-46b9-b697-01e3fe322265 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:45:15.790191 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-d0b3a6a3-e259-46b9-b697-01e3fe322265 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: 486ab1d3-d971-40c2-aca6-4ce6ef472355] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:45:15.799818 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d0b3a6a3-e259-46b9-b697-01e3fe322265 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:15.800335 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d0b3a6a3-e259-46b9-b697-01e3fe322265 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:15.801187 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d0b3a6a3-e259-46b9-b697-01e3fe322265 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:15.801685 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d0b3a6a3-e259-46b9-b697-01e3fe322265 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:15.927770 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-d0b3a6a3-e259-46b9-b697-01e3fe322265 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "POST /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355/action" status: 200 len: 28209 microversion: 2.1 time: 0.142924 Feb 17 04:45:15.928478 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 463/919] 10.222.0.38 () {60 vars in 1268 bytes} [Wed Feb 17 04:45:15 2021] POST /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355/action => generated 28209 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:45:16.549604 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-228fd1a7-cb56-480f-a719-6c26b948edaf tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:45:16.550319 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-228fd1a7-cb56-480f-a719-6c26b948edaf tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] [instance: e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:45:16.559595 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-228fd1a7-cb56-480f-a719-6c26b948edaf tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:16.560129 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-228fd1a7-cb56-480f-a719-6c26b948edaf tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:16.560939 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-228fd1a7-cb56-480f-a719-6c26b948edaf tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:16.561432 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-228fd1a7-cb56-480f-a719-6c26b948edaf tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:16.766833 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-228fd1a7-cb56-480f-a719-6c26b948edaf tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cd0aa08bfc4637a988f25eec8cfb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca59cfbe7f3b494499cc8efe1d0e093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:45:16.775633 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-228fd1a7-cb56-480f-a719-6c26b948edaf tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] 10.222.0.38 "GET /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2" status: 200 len: 1573 microversion: 2.1 time: 0.230087 Feb 17 04:45:16.776230 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 457/920] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:45:16 2021] GET /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2 => generated 1573 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:45:16.941455 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-38da071a-1d57-4d0d-854a-62cef19961f2 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:45:16.942677 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-38da071a-1d57-4d0d-854a-62cef19961f2 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: 486ab1d3-d971-40c2-aca6-4ce6ef472355] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:45:16.952324 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-38da071a-1d57-4d0d-854a-62cef19961f2 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:16.952838 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-38da071a-1d57-4d0d-854a-62cef19961f2 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:16.953689 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-38da071a-1d57-4d0d-854a-62cef19961f2 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:16.954183 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-38da071a-1d57-4d0d-854a-62cef19961f2 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:17.063292 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-38da071a-1d57-4d0d-854a-62cef19961f2 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "POST /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355/action" status: 200 len: 28209 microversion: 2.1 time: 0.126114 Feb 17 04:45:17.064272 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 464/921] 10.222.0.38 () {60 vars in 1268 bytes} [Wed Feb 17 04:45:16 2021] POST /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355/action => generated 28209 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:45:17.794428 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-9f0681b8-a578-45e5-a6c1-a0c642817df2 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:45:17.795132 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-9f0681b8-a578-45e5-a6c1-a0c642817df2 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] [instance: e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:45:17.803110 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9f0681b8-a578-45e5-a6c1-a0c642817df2 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:17.803611 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9f0681b8-a578-45e5-a6c1-a0c642817df2 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:17.804444 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9f0681b8-a578-45e5-a6c1-a0c642817df2 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:17.804924 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9f0681b8-a578-45e5-a6c1-a0c642817df2 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:18.021219 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-9f0681b8-a578-45e5-a6c1-a0c642817df2 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cd0aa08bfc4637a988f25eec8cfb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca59cfbe7f3b494499cc8efe1d0e093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:45:18.030946 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-9f0681b8-a578-45e5-a6c1-a0c642817df2 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] 10.222.0.38 "GET /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2" status: 200 len: 1573 microversion: 2.1 time: 0.241382 Feb 17 04:45:18.031535 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 458/922] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:45:17 2021] GET /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2 => generated 1573 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:45:18.076837 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-6c5a8e20-e07c-40ad-987e-49fb98bdfb0b tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:45:18.077906 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-6c5a8e20-e07c-40ad-987e-49fb98bdfb0b tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: 486ab1d3-d971-40c2-aca6-4ce6ef472355] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:45:18.086369 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6c5a8e20-e07c-40ad-987e-49fb98bdfb0b tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:18.086906 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6c5a8e20-e07c-40ad-987e-49fb98bdfb0b tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:18.087736 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6c5a8e20-e07c-40ad-987e-49fb98bdfb0b tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:18.088226 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6c5a8e20-e07c-40ad-987e-49fb98bdfb0b tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:18.207121 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-6c5a8e20-e07c-40ad-987e-49fb98bdfb0b tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "POST /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355/action" status: 200 len: 28500 microversion: 2.1 time: 0.135163 Feb 17 04:45:18.208066 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 465/923] 10.222.0.38 () {60 vars in 1268 bytes} [Wed Feb 17 04:45:18 2021] POST /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355/action => generated 28500 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:45:19.049797 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-78d6c913-43a4-4e91-a20a-63f59cd7948b tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:45:19.050474 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-78d6c913-43a4-4e91-a20a-63f59cd7948b tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] [instance: e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:45:19.059294 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-78d6c913-43a4-4e91-a20a-63f59cd7948b tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:19.059805 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-78d6c913-43a4-4e91-a20a-63f59cd7948b tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:19.060644 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-78d6c913-43a4-4e91-a20a-63f59cd7948b tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:19.061140 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-78d6c913-43a4-4e91-a20a-63f59cd7948b tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:19.221090 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-40571f64-412a-4de1-950d-63581e7a2713 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:45:19.222282 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-40571f64-412a-4de1-950d-63581e7a2713 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: 486ab1d3-d971-40c2-aca6-4ce6ef472355] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:45:19.231756 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-40571f64-412a-4de1-950d-63581e7a2713 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:19.232278 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-40571f64-412a-4de1-950d-63581e7a2713 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:19.233132 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-40571f64-412a-4de1-950d-63581e7a2713 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:19.233633 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-40571f64-412a-4de1-950d-63581e7a2713 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:19.273731 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-78d6c913-43a4-4e91-a20a-63f59cd7948b tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cd0aa08bfc4637a988f25eec8cfb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca59cfbe7f3b494499cc8efe1d0e093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:45:19.282896 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-78d6c913-43a4-4e91-a20a-63f59cd7948b tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] 10.222.0.38 "GET /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2" status: 200 len: 1573 microversion: 2.1 time: 0.237221 Feb 17 04:45:19.283506 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 459/924] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:45:19 2021] GET /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2 => generated 1573 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:45:19.348894 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-40571f64-412a-4de1-950d-63581e7a2713 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "POST /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355/action" status: 200 len: 28668 microversion: 2.1 time: 0.132358 Feb 17 04:45:19.349843 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 466/925] 10.222.0.38 () {60 vars in 1268 bytes} [Wed Feb 17 04:45:19 2021] POST /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355/action => generated 28668 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 04:45:20.301168 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-681582ed-87b1-4175-b44b-1b8832a47fe0 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:45:20.301761 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-681582ed-87b1-4175-b44b-1b8832a47fe0 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] [instance: e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:45:20.310219 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-681582ed-87b1-4175-b44b-1b8832a47fe0 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:20.310751 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-681582ed-87b1-4175-b44b-1b8832a47fe0 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:20.311584 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-681582ed-87b1-4175-b44b-1b8832a47fe0 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:20.312076 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-681582ed-87b1-4175-b44b-1b8832a47fe0 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:20.362474 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-60433792-2397-4d57-a7ec-badabee016b5 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:45:20.363738 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-60433792-2397-4d57-a7ec-badabee016b5 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: 486ab1d3-d971-40c2-aca6-4ce6ef472355] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:45:20.372408 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-60433792-2397-4d57-a7ec-badabee016b5 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:20.372927 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-60433792-2397-4d57-a7ec-badabee016b5 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:20.373776 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-60433792-2397-4d57-a7ec-badabee016b5 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:20.374280 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-60433792-2397-4d57-a7ec-badabee016b5 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:20.478654 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-60433792-2397-4d57-a7ec-badabee016b5 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "POST /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355/action" status: 200 len: 28668 microversion: 2.1 time: 0.120449 Feb 17 04:45:20.479372 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 467/926] 10.222.0.38 () {60 vars in 1268 bytes} [Wed Feb 17 04:45:20 2021] POST /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355/action => generated 28668 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 04:45:20.526200 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-681582ed-87b1-4175-b44b-1b8832a47fe0 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cd0aa08bfc4637a988f25eec8cfb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca59cfbe7f3b494499cc8efe1d0e093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:45:20.535901 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-681582ed-87b1-4175-b44b-1b8832a47fe0 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] 10.222.0.38 "GET /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2" status: 200 len: 1573 microversion: 2.1 time: 0.238820 Feb 17 04:45:20.536501 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 460/927] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:45:20 2021] GET /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2 => generated 1573 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:45:21.491854 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-08fed76c-dc18-4bbe-b91f-28bbff88c649 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:45:21.492984 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-08fed76c-dc18-4bbe-b91f-28bbff88c649 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: 486ab1d3-d971-40c2-aca6-4ce6ef472355] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:45:21.502153 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-08fed76c-dc18-4bbe-b91f-28bbff88c649 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:21.502712 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-08fed76c-dc18-4bbe-b91f-28bbff88c649 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:21.503551 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-08fed76c-dc18-4bbe-b91f-28bbff88c649 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:21.504055 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-08fed76c-dc18-4bbe-b91f-28bbff88c649 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:21.554367 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-e7cf505d-0417-4eee-98e6-bffb109e87ce tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:45:21.555060 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-e7cf505d-0417-4eee-98e6-bffb109e87ce tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] [instance: e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:45:21.563739 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e7cf505d-0417-4eee-98e6-bffb109e87ce tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:21.564247 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e7cf505d-0417-4eee-98e6-bffb109e87ce tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:21.565087 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e7cf505d-0417-4eee-98e6-bffb109e87ce tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:21.565584 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e7cf505d-0417-4eee-98e6-bffb109e87ce tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:21.608855 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-08fed76c-dc18-4bbe-b91f-28bbff88c649 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "POST /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355/action" status: 200 len: 28668 microversion: 2.1 time: 0.121313 Feb 17 04:45:21.609828 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 468/928] 10.222.0.38 () {60 vars in 1268 bytes} [Wed Feb 17 04:45:21 2021] POST /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355/action => generated 28668 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:45:21.783384 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-e7cf505d-0417-4eee-98e6-bffb109e87ce tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cd0aa08bfc4637a988f25eec8cfb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca59cfbe7f3b494499cc8efe1d0e093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:45:21.792149 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-e7cf505d-0417-4eee-98e6-bffb109e87ce tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] 10.222.0.38 "GET /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2" status: 200 len: 1573 microversion: 2.1 time: 0.241883 Feb 17 04:45:21.792749 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 461/929] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:45:21 2021] GET /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2 => generated 1573 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:45:22.622251 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-654a6310-97f2-4706-ba57-8887dcf3d6c8 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:45:22.623426 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-654a6310-97f2-4706-ba57-8887dcf3d6c8 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: 486ab1d3-d971-40c2-aca6-4ce6ef472355] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:45:22.632055 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-654a6310-97f2-4706-ba57-8887dcf3d6c8 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:22.632571 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-654a6310-97f2-4706-ba57-8887dcf3d6c8 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:22.633465 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-654a6310-97f2-4706-ba57-8887dcf3d6c8 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:22.633968 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-654a6310-97f2-4706-ba57-8887dcf3d6c8 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:22.748377 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-654a6310-97f2-4706-ba57-8887dcf3d6c8 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "POST /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355/action" status: 200 len: 29474 microversion: 2.1 time: 0.130746 Feb 17 04:45:22.749046 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 469/930] 10.222.0.38 () {60 vars in 1268 bytes} [Wed Feb 17 04:45:22 2021] POST /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355/action => generated 29474 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:45:22.810555 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-80955bb8-eeb4-4c0f-a1d8-e7115a7cd641 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:45:22.811245 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-80955bb8-eeb4-4c0f-a1d8-e7115a7cd641 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] [instance: e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:45:22.819042 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-80955bb8-eeb4-4c0f-a1d8-e7115a7cd641 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:22.819583 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-80955bb8-eeb4-4c0f-a1d8-e7115a7cd641 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:22.820411 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-80955bb8-eeb4-4c0f-a1d8-e7115a7cd641 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:22.820902 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-80955bb8-eeb4-4c0f-a1d8-e7115a7cd641 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:23.090969 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-80955bb8-eeb4-4c0f-a1d8-e7115a7cd641 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cd0aa08bfc4637a988f25eec8cfb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca59cfbe7f3b494499cc8efe1d0e093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:45:23.100078 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-80955bb8-eeb4-4c0f-a1d8-e7115a7cd641 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] 10.222.0.38 "GET /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2" status: 200 len: 1573 microversion: 2.1 time: 0.293898 Feb 17 04:45:23.100698 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 462/931] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:45:22 2021] GET /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2 => generated 1573 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:45:23.762554 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-5d6eab00-48ca-4329-9b1d-d15805c0ea6e tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:45:23.763785 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-5d6eab00-48ca-4329-9b1d-d15805c0ea6e tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: 486ab1d3-d971-40c2-aca6-4ce6ef472355] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:45:23.772439 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5d6eab00-48ca-4329-9b1d-d15805c0ea6e tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:23.772962 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5d6eab00-48ca-4329-9b1d-d15805c0ea6e tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:23.773818 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5d6eab00-48ca-4329-9b1d-d15805c0ea6e tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:23.774320 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5d6eab00-48ca-4329-9b1d-d15805c0ea6e tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:23.892661 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-5d6eab00-48ca-4329-9b1d-d15805c0ea6e tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "POST /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355/action" status: 200 len: 31457 microversion: 2.1 time: 0.135287 Feb 17 04:45:23.893693 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 470/932] 10.222.0.38 () {60 vars in 1268 bytes} [Wed Feb 17 04:45:23 2021] POST /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355/action => generated 31457 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:45:24.119181 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-21e17029-290f-47d9-af81-831455bf35f8 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:45:24.119874 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-21e17029-290f-47d9-af81-831455bf35f8 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] [instance: e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:45:24.129604 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-21e17029-290f-47d9-af81-831455bf35f8 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:24.130113 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-21e17029-290f-47d9-af81-831455bf35f8 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:24.131017 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-21e17029-290f-47d9-af81-831455bf35f8 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:24.131515 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-21e17029-290f-47d9-af81-831455bf35f8 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:24.629617 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-21e17029-290f-47d9-af81-831455bf35f8 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cd0aa08bfc4637a988f25eec8cfb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca59cfbe7f3b494499cc8efe1d0e093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:45:24.639208 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-21e17029-290f-47d9-af81-831455bf35f8 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] 10.222.0.38 "GET /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2" status: 200 len: 1573 microversion: 2.1 time: 0.524125 Feb 17 04:45:24.639827 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 463/933] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:45:24 2021] GET /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2 => generated 1573 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:45:24.906581 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-1407eead-1982-4c0c-9157-366109217827 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:45:24.908046 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-1407eead-1982-4c0c-9157-366109217827 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: 486ab1d3-d971-40c2-aca6-4ce6ef472355] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:45:24.916388 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1407eead-1982-4c0c-9157-366109217827 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:24.916985 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1407eead-1982-4c0c-9157-366109217827 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:24.917828 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1407eead-1982-4c0c-9157-366109217827 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:24.918326 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1407eead-1982-4c0c-9157-366109217827 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:25.032155 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-1407eead-1982-4c0c-9157-366109217827 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "POST /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355/action" status: 200 len: 32991 microversion: 2.1 time: 0.130517 Feb 17 04:45:25.032855 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 471/934] 10.222.0.38 () {60 vars in 1268 bytes} [Wed Feb 17 04:45:24 2021] POST /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355/action => generated 32991 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:45:25.658064 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-a875a373-d98f-49c2-b6cd-32773c372ab9 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:45:25.658773 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-a875a373-d98f-49c2-b6cd-32773c372ab9 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] [instance: e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:45:25.666527 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a875a373-d98f-49c2-b6cd-32773c372ab9 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:25.667288 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a875a373-d98f-49c2-b6cd-32773c372ab9 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:25.668073 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a875a373-d98f-49c2-b6cd-32773c372ab9 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:25.668574 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a875a373-d98f-49c2-b6cd-32773c372ab9 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:25.887301 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-a875a373-d98f-49c2-b6cd-32773c372ab9 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cd0aa08bfc4637a988f25eec8cfb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca59cfbe7f3b494499cc8efe1d0e093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:45:25.897057 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-a875a373-d98f-49c2-b6cd-32773c372ab9 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] 10.222.0.38 "GET /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2" status: 200 len: 1573 microversion: 2.1 time: 0.242826 Feb 17 04:45:25.897712 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 464/935] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:45:25 2021] GET /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2 => generated 1573 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:45:26.046241 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-6838993e-f7d3-4b34-93cb-4e23a9c0b60b tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:45:26.047467 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-6838993e-f7d3-4b34-93cb-4e23a9c0b60b tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: 486ab1d3-d971-40c2-aca6-4ce6ef472355] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:45:26.057084 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6838993e-f7d3-4b34-93cb-4e23a9c0b60b tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:26.057588 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6838993e-f7d3-4b34-93cb-4e23a9c0b60b tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:26.059557 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6838993e-f7d3-4b34-93cb-4e23a9c0b60b tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:26.060431 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6838993e-f7d3-4b34-93cb-4e23a9c0b60b tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:26.133902 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [req-d08e2897-dc3a-42b1-9fcc-d250b03c21aa req-a4ed31c4-564c-4e1f-82a4-c13932df4ce5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2", "name": "network-vif-unplugged", "status": "completed", "tag": "6738a807-1bee-443c-9281-dcce36604367"}]} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:45:26.136184 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:45:26.136184 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:45:26.146394 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-d08e2897-dc3a-42b1-9fcc-d250b03c21aa req-a4ed31c4-564c-4e1f-82a4-c13932df4ce5 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:26.147289 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-d08e2897-dc3a-42b1-9fcc-d250b03c21aa req-a4ed31c4-564c-4e1f-82a4-c13932df4ce5 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:26.165239 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.compute.server_external_events [req-d08e2897-dc3a-42b1-9fcc-d250b03c21aa req-a4ed31c4-564c-4e1f-82a4-c13932df4ce5 service nova] Creating event network-vif-unplugged:6738a807-1bee-443c-9281-dcce36604367 for instance e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2 on hv-cinder-76019 Feb 17 04:45:26.170533 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [req-d08e2897-dc3a-42b1-9fcc-d250b03c21aa req-a4ed31c4-564c-4e1f-82a4-c13932df4ce5 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041331 Feb 17 04:45:26.171617 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 465/936] 10.222.0.38 () {64 vars in 1308 bytes} [Wed Feb 17 04:45:26 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:45:26.175504 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-6838993e-f7d3-4b34-93cb-4e23a9c0b60b tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "POST /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355/action" status: 200 len: 33851 microversion: 2.1 time: 0.134154 Feb 17 04:45:26.177726 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 472/937] 10.222.0.38 () {60 vars in 1268 bytes} [Wed Feb 17 04:45:26 2021] POST /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355/action => generated 33851 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:45:26.916483 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-7954ee18-1432-482f-b0ab-783f5e94730a tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:45:26.917260 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-7954ee18-1432-482f-b0ab-783f5e94730a tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] [instance: e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:45:26.930387 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7954ee18-1432-482f-b0ab-783f5e94730a tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:26.930952 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7954ee18-1432-482f-b0ab-783f5e94730a tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:26.931797 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7954ee18-1432-482f-b0ab-783f5e94730a tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:26.932318 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7954ee18-1432-482f-b0ab-783f5e94730a tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:27.163838 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-7954ee18-1432-482f-b0ab-783f5e94730a tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cd0aa08bfc4637a988f25eec8cfb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca59cfbe7f3b494499cc8efe1d0e093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:45:27.179485 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-7954ee18-1432-482f-b0ab-783f5e94730a tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] 10.222.0.38 "GET /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2" status: 200 len: 1514 microversion: 2.1 time: 0.266988 Feb 17 04:45:27.180153 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 466/938] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:45:26 2021] GET /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2 => generated 1514 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:45:27.189530 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-247ecaf7-c8fa-479f-a089-19ff6c5311e3 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:45:27.190958 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-247ecaf7-c8fa-479f-a089-19ff6c5311e3 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: 486ab1d3-d971-40c2-aca6-4ce6ef472355] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:45:27.200657 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-f971dc4f-f432-475d-a65a-930a0b2cf91b tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:45:27.201289 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-f971dc4f-f432-475d-a65a-930a0b2cf91b tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] [instance: e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:45:27.203806 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-247ecaf7-c8fa-479f-a089-19ff6c5311e3 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:27.204324 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-247ecaf7-c8fa-479f-a089-19ff6c5311e3 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:27.205178 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-247ecaf7-c8fa-479f-a089-19ff6c5311e3 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:27.205672 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-247ecaf7-c8fa-479f-a089-19ff6c5311e3 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:27.211433 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f971dc4f-f432-475d-a65a-930a0b2cf91b tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:27.212371 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f971dc4f-f432-475d-a65a-930a0b2cf91b tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:27.213879 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f971dc4f-f432-475d-a65a-930a0b2cf91b tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:27.215536 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f971dc4f-f432-475d-a65a-930a0b2cf91b tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:27.322580 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-247ecaf7-c8fa-479f-a089-19ff6c5311e3 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "POST /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355/action" status: 200 len: 35082 microversion: 2.1 time: 0.137430 Feb 17 04:45:27.328383 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 473/939] 10.222.0.38 () {60 vars in 1268 bytes} [Wed Feb 17 04:45:27 2021] POST /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355/action => generated 35082 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:45:27.421193 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-f971dc4f-f432-475d-a65a-930a0b2cf91b tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] 10.222.0.38 "POST /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2/action" status: 202 len: 0 microversion: 2.1 time: 0.225491 Feb 17 04:45:27.421874 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 467/940] 10.222.0.38 () {60 vars in 1268 bytes} [Wed Feb 17 04:45:27 2021] POST /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:45:27.431571 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-f00fc599-7310-4596-9c69-6b06860ac6c7 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:45:27.432358 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-f00fc599-7310-4596-9c69-6b06860ac6c7 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] [instance: e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:45:27.441880 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f00fc599-7310-4596-9c69-6b06860ac6c7 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:27.442392 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f00fc599-7310-4596-9c69-6b06860ac6c7 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:27.443265 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f00fc599-7310-4596-9c69-6b06860ac6c7 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:27.443770 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f00fc599-7310-4596-9c69-6b06860ac6c7 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:27.695553 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-f00fc599-7310-4596-9c69-6b06860ac6c7 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cd0aa08bfc4637a988f25eec8cfb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca59cfbe7f3b494499cc8efe1d0e093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:45:27.706785 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-f00fc599-7310-4596-9c69-6b06860ac6c7 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] 10.222.0.38 "GET /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2" status: 200 len: 1522 microversion: 2.1 time: 0.279767 Feb 17 04:45:27.707423 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 474/941] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:45:27 2021] GET /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2 => generated 1522 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:45:28.336539 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-ee287b12-e5dc-4de6-882c-4bca4b38e920 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:45:28.337628 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-ee287b12-e5dc-4de6-882c-4bca4b38e920 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: 486ab1d3-d971-40c2-aca6-4ce6ef472355] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:45:28.346195 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ee287b12-e5dc-4de6-882c-4bca4b38e920 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:28.346732 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ee287b12-e5dc-4de6-882c-4bca4b38e920 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:28.347572 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ee287b12-e5dc-4de6-882c-4bca4b38e920 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:28.348070 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ee287b12-e5dc-4de6-882c-4bca4b38e920 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:28.458652 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-ee287b12-e5dc-4de6-882c-4bca4b38e920 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "POST /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355/action" status: 200 len: 36617 microversion: 2.1 time: 0.125936 Feb 17 04:45:28.459338 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 468/942] 10.222.0.38 () {60 vars in 1268 bytes} [Wed Feb 17 04:45:28 2021] POST /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355/action => generated 36617 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:45:28.727195 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-314337f3-99bb-4483-9f03-a941df99b4cd tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:45:28.727790 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-314337f3-99bb-4483-9f03-a941df99b4cd tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] [instance: e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:45:28.736257 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-314337f3-99bb-4483-9f03-a941df99b4cd tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:28.736763 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-314337f3-99bb-4483-9f03-a941df99b4cd tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:28.737594 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-314337f3-99bb-4483-9f03-a941df99b4cd tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:28.738086 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-314337f3-99bb-4483-9f03-a941df99b4cd tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:28.951415 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-314337f3-99bb-4483-9f03-a941df99b4cd tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cd0aa08bfc4637a988f25eec8cfb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca59cfbe7f3b494499cc8efe1d0e093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:45:28.961025 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-314337f3-99bb-4483-9f03-a941df99b4cd tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] 10.222.0.38 "GET /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2" status: 200 len: 1522 microversion: 2.1 time: 0.237967 Feb 17 04:45:28.961729 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 475/943] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:45:28 2021] GET /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2 => generated 1522 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:45:29.472422 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-bb6d51b8-8ad2-404d-8419-7c900f292d0b tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:45:29.473499 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-bb6d51b8-8ad2-404d-8419-7c900f292d0b tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: 486ab1d3-d971-40c2-aca6-4ce6ef472355] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:45:29.482784 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-bb6d51b8-8ad2-404d-8419-7c900f292d0b tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:29.483308 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-bb6d51b8-8ad2-404d-8419-7c900f292d0b tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:29.484159 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-bb6d51b8-8ad2-404d-8419-7c900f292d0b tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:29.484662 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-bb6d51b8-8ad2-404d-8419-7c900f292d0b tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:29.596250 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-bb6d51b8-8ad2-404d-8419-7c900f292d0b tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "POST /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355/action" status: 200 len: 38198 microversion: 2.1 time: 0.128283 Feb 17 04:45:29.597071 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 469/944] 10.222.0.38 () {60 vars in 1268 bytes} [Wed Feb 17 04:45:29 2021] POST /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355/action => generated 38198 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:45:29.981042 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-ed030261-2353-48db-985b-c8578e5f6940 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:45:29.982292 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-ed030261-2353-48db-985b-c8578e5f6940 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] [instance: e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:45:29.992541 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ed030261-2353-48db-985b-c8578e5f6940 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:29.993627 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ed030261-2353-48db-985b-c8578e5f6940 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:29.994589 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ed030261-2353-48db-985b-c8578e5f6940 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:29.995442 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ed030261-2353-48db-985b-c8578e5f6940 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:30.394908 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-ed030261-2353-48db-985b-c8578e5f6940 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cd0aa08bfc4637a988f25eec8cfb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca59cfbe7f3b494499cc8efe1d0e093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:45:30.403785 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-ed030261-2353-48db-985b-c8578e5f6940 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] 10.222.0.38 "GET /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2" status: 200 len: 1524 microversion: 2.1 time: 0.427928 Feb 17 04:45:30.404402 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 476/945] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:45:29 2021] GET /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2 => generated 1524 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:45:30.609659 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-16815375-9553-4adf-bed4-645a6f6931b9 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:45:30.610926 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-16815375-9553-4adf-bed4-645a6f6931b9 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: 486ab1d3-d971-40c2-aca6-4ce6ef472355] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:45:30.619716 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-16815375-9553-4adf-bed4-645a6f6931b9 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:30.620239 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-16815375-9553-4adf-bed4-645a6f6931b9 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:30.621657 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-16815375-9553-4adf-bed4-645a6f6931b9 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:30.622198 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-16815375-9553-4adf-bed4-645a6f6931b9 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:30.722369 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-16815375-9553-4adf-bed4-645a6f6931b9 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "POST /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355/action" status: 200 len: 38198 microversion: 2.1 time: 0.117095 Feb 17 04:45:30.723360 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 470/946] 10.222.0.38 () {60 vars in 1268 bytes} [Wed Feb 17 04:45:30 2021] POST /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355/action => generated 38198 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:45:31.423348 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-a1736652-08af-4930-95b7-f2f7698d4ccf tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:45:31.424013 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-a1736652-08af-4930-95b7-f2f7698d4ccf tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] [instance: e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:45:31.432236 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a1736652-08af-4930-95b7-f2f7698d4ccf tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:31.432744 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a1736652-08af-4930-95b7-f2f7698d4ccf tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:31.434033 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a1736652-08af-4930-95b7-f2f7698d4ccf tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:31.434534 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a1736652-08af-4930-95b7-f2f7698d4ccf tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:31.640939 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-a1736652-08af-4930-95b7-f2f7698d4ccf tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cd0aa08bfc4637a988f25eec8cfb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca59cfbe7f3b494499cc8efe1d0e093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:45:31.649758 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-a1736652-08af-4930-95b7-f2f7698d4ccf tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] 10.222.0.38 "GET /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2" status: 200 len: 1580 microversion: 2.1 time: 0.230781 Feb 17 04:45:31.650356 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 477/947] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:45:31 2021] GET /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2 => generated 1580 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:45:31.735733 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-0c05d044-4c28-4195-91a5-2d4483375dd6 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:45:31.736952 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-0c05d044-4c28-4195-91a5-2d4483375dd6 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: 486ab1d3-d971-40c2-aca6-4ce6ef472355] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:45:31.745582 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0c05d044-4c28-4195-91a5-2d4483375dd6 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:31.746120 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0c05d044-4c28-4195-91a5-2d4483375dd6 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:31.746991 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0c05d044-4c28-4195-91a5-2d4483375dd6 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:31.747494 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0c05d044-4c28-4195-91a5-2d4483375dd6 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:31.844156 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-0c05d044-4c28-4195-91a5-2d4483375dd6 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "POST /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355/action" status: 200 len: 38198 microversion: 2.1 time: 0.112796 Feb 17 04:45:31.845017 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 471/948] 10.222.0.38 () {60 vars in 1268 bytes} [Wed Feb 17 04:45:31 2021] POST /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355/action => generated 38198 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:45:32.668629 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-dbc4e2f8-696d-43e9-9c34-b15558010035 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:45:32.669241 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-dbc4e2f8-696d-43e9-9c34-b15558010035 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] [instance: e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:45:32.677203 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-dbc4e2f8-696d-43e9-9c34-b15558010035 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:32.677720 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-dbc4e2f8-696d-43e9-9c34-b15558010035 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:32.678595 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-dbc4e2f8-696d-43e9-9c34-b15558010035 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:32.679116 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-dbc4e2f8-696d-43e9-9c34-b15558010035 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:32.858055 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-a53b1d7a-9a7f-4d33-8696-8083dd938336 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:45:32.859266 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-a53b1d7a-9a7f-4d33-8696-8083dd938336 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: 486ab1d3-d971-40c2-aca6-4ce6ef472355] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:45:32.867983 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a53b1d7a-9a7f-4d33-8696-8083dd938336 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:32.868502 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a53b1d7a-9a7f-4d33-8696-8083dd938336 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:32.869350 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a53b1d7a-9a7f-4d33-8696-8083dd938336 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:32.869847 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a53b1d7a-9a7f-4d33-8696-8083dd938336 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:32.892895 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-dbc4e2f8-696d-43e9-9c34-b15558010035 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cd0aa08bfc4637a988f25eec8cfb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca59cfbe7f3b494499cc8efe1d0e093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:45:32.902915 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-dbc4e2f8-696d-43e9-9c34-b15558010035 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] 10.222.0.38 "GET /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2" status: 200 len: 1580 microversion: 2.1 time: 0.238473 Feb 17 04:45:32.904355 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 478/949] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:45:32 2021] GET /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2 => generated 1580 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:45:32.970392 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-a53b1d7a-9a7f-4d33-8696-8083dd938336 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "POST /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355/action" status: 200 len: 38198 microversion: 2.1 time: 0.117042 Feb 17 04:45:32.971290 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 472/950] 10.222.0.38 () {60 vars in 1268 bytes} [Wed Feb 17 04:45:32 2021] POST /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355/action => generated 38198 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 04:45:33.922356 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-2969c336-081a-4d13-830e-04c65b13639c tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:45:33.923060 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-2969c336-081a-4d13-830e-04c65b13639c tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] [instance: e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:45:33.931200 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2969c336-081a-4d13-830e-04c65b13639c tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:33.931718 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2969c336-081a-4d13-830e-04c65b13639c tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:33.932564 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2969c336-081a-4d13-830e-04c65b13639c tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:33.933068 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2969c336-081a-4d13-830e-04c65b13639c tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:33.984381 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-6819e9ce-7e5c-4d5e-a62a-7c0dd92d3a19 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:45:33.985640 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-6819e9ce-7e5c-4d5e-a62a-7c0dd92d3a19 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: 486ab1d3-d971-40c2-aca6-4ce6ef472355] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:45:33.994688 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6819e9ce-7e5c-4d5e-a62a-7c0dd92d3a19 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:33.995179 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6819e9ce-7e5c-4d5e-a62a-7c0dd92d3a19 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:33.996752 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6819e9ce-7e5c-4d5e-a62a-7c0dd92d3a19 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:33.997258 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6819e9ce-7e5c-4d5e-a62a-7c0dd92d3a19 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:34.109456 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-6819e9ce-7e5c-4d5e-a62a-7c0dd92d3a19 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "POST /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355/action" status: 200 len: 38329 microversion: 2.1 time: 0.130165 Feb 17 04:45:34.110484 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 473/951] 10.222.0.38 () {60 vars in 1268 bytes} [Wed Feb 17 04:45:33 2021] POST /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355/action => generated 38329 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 04:45:34.121404 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-6129dde3-851d-4ccb-8fec-35f41f798ac7 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:45:34.122258 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-6129dde3-851d-4ccb-8fec-35f41f798ac7 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: 486ab1d3-d971-40c2-aca6-4ce6ef472355] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:45:34.130845 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6129dde3-851d-4ccb-8fec-35f41f798ac7 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:34.131361 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6129dde3-851d-4ccb-8fec-35f41f798ac7 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:34.132215 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6129dde3-851d-4ccb-8fec-35f41f798ac7 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:34.132712 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6129dde3-851d-4ccb-8fec-35f41f798ac7 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:34.157316 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-2969c336-081a-4d13-830e-04c65b13639c tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cd0aa08bfc4637a988f25eec8cfb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca59cfbe7f3b494499cc8efe1d0e093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:45:34.166438 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-2969c336-081a-4d13-830e-04c65b13639c tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] 10.222.0.38 "GET /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2" status: 200 len: 1580 microversion: 2.1 time: 0.248731 Feb 17 04:45:34.167248 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 479/952] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:45:33 2021] GET /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2 => generated 1580 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:45:34.194932 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-6129dde3-851d-4ccb-8fec-35f41f798ac7 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "GET /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355/ips" status: 200 len: 146 microversion: 2.1 time: 0.078188 Feb 17 04:45:34.195503 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 474/953] 10.222.0.38 () {58 vars in 1238 bytes} [Wed Feb 17 04:45:34 2021] GET /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355/ips => generated 146 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:45:35.185213 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-417b8c90-a7a7-4450-b4d4-341cbbaf9758 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:45:35.185889 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-417b8c90-a7a7-4450-b4d4-341cbbaf9758 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] [instance: e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:45:35.193720 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-417b8c90-a7a7-4450-b4d4-341cbbaf9758 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:35.194238 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-417b8c90-a7a7-4450-b4d4-341cbbaf9758 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:35.195124 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-417b8c90-a7a7-4450-b4d4-341cbbaf9758 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:35.195766 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-417b8c90-a7a7-4450-b4d4-341cbbaf9758 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:35.415307 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-417b8c90-a7a7-4450-b4d4-341cbbaf9758 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cd0aa08bfc4637a988f25eec8cfb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca59cfbe7f3b494499cc8efe1d0e093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:45:35.424267 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-417b8c90-a7a7-4450-b4d4-341cbbaf9758 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] 10.222.0.38 "GET /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2" status: 200 len: 1580 microversion: 2.1 time: 0.243288 Feb 17 04:45:35.424864 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 480/954] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:45:35 2021] GET /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2 => generated 1580 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:45:36.442591 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-1974674e-bde5-4995-a209-da0350f1b990 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:45:36.443279 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-1974674e-bde5-4995-a209-da0350f1b990 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] [instance: e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:45:36.452108 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1974674e-bde5-4995-a209-da0350f1b990 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:36.452620 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1974674e-bde5-4995-a209-da0350f1b990 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:36.453464 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1974674e-bde5-4995-a209-da0350f1b990 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:36.453962 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1974674e-bde5-4995-a209-da0350f1b990 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:36.519127 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-fd41556c-8f75-4e1c-a2fe-7bb588b489e5 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "feda2408-a80f-449b-a3ba-8732877a2fc5"}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:45:36.520329 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-fd41556c-8f75-4e1c-a2fe-7bb588b489e5 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: 486ab1d3-d971-40c2-aca6-4ce6ef472355] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:45:36.529426 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-fd41556c-8f75-4e1c-a2fe-7bb588b489e5 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:36.530043 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-fd41556c-8f75-4e1c-a2fe-7bb588b489e5 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:36.530945 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-fd41556c-8f75-4e1c-a2fe-7bb588b489e5 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:36.531449 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-fd41556c-8f75-4e1c-a2fe-7bb588b489e5 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:36.674220 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-1974674e-bde5-4995-a209-da0350f1b990 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cd0aa08bfc4637a988f25eec8cfb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca59cfbe7f3b494499cc8efe1d0e093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:45:36.683947 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-1974674e-bde5-4995-a209-da0350f1b990 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] 10.222.0.38 "GET /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2" status: 200 len: 1580 microversion: 2.1 time: 0.244694 Feb 17 04:45:36.684565 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 475/955] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:45:36 2021] GET /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2 => generated 1580 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:45:36.899694 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-fd41556c-8f75-4e1c-a2fe-7bb588b489e5 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "POST /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.384369 Feb 17 04:45:36.900486 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 481/956] 10.222.0.38 () {60 vars in 1313 bytes} [Wed Feb 17 04:45:36 2021] POST /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355/os-volume_attachments => generated 194 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:45:37.702603 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-bc5a69cd-169f-4b71-876c-b22132713951 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:45:37.703324 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-bc5a69cd-169f-4b71-876c-b22132713951 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] [instance: e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:45:37.711088 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-bc5a69cd-169f-4b71-876c-b22132713951 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:37.711595 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-bc5a69cd-169f-4b71-876c-b22132713951 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:37.712425 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-bc5a69cd-169f-4b71-876c-b22132713951 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:37.712915 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-bc5a69cd-169f-4b71-876c-b22132713951 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:37.922242 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-bc5a69cd-169f-4b71-876c-b22132713951 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cd0aa08bfc4637a988f25eec8cfb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca59cfbe7f3b494499cc8efe1d0e093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:45:37.931068 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-bc5a69cd-169f-4b71-876c-b22132713951 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] 10.222.0.38 "GET /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2" status: 200 len: 1580 microversion: 2.1 time: 0.232931 Feb 17 04:45:37.931670 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 476/957] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:45:37 2021] GET /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2 => generated 1580 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:45:38.426388 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [req-4963c13d-eb1a-494b-9107-e05a168dcefb req-d9da8f64-5178-4f7f-bdcf-da6aaa655c4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2", "name": "network-vif-plugged", "status": "completed", "tag": "6738a807-1bee-443c-9281-dcce36604367"}]} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:45:38.428215 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:45:38.428215 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:45:38.439113 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-4963c13d-eb1a-494b-9107-e05a168dcefb req-d9da8f64-5178-4f7f-bdcf-da6aaa655c4f service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:38.439627 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-4963c13d-eb1a-494b-9107-e05a168dcefb req-d9da8f64-5178-4f7f-bdcf-da6aaa655c4f service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:38.457274 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.compute.server_external_events [req-4963c13d-eb1a-494b-9107-e05a168dcefb req-d9da8f64-5178-4f7f-bdcf-da6aaa655c4f service nova] Creating event network-vif-plugged:6738a807-1bee-443c-9281-dcce36604367 for instance e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2 on hv-cinder-76019 Feb 17 04:45:38.462540 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [req-4963c13d-eb1a-494b-9107-e05a168dcefb req-d9da8f64-5178-4f7f-bdcf-da6aaa655c4f service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041172 Feb 17 04:45:38.463234 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 482/958] 10.222.0.38 () {64 vars in 1308 bytes} [Wed Feb 17 04:45:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:45:38.950846 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-2b8e3970-b801-429e-a899-0f2c17daf041 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:45:38.951532 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-2b8e3970-b801-429e-a899-0f2c17daf041 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] [instance: e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:45:38.959899 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2b8e3970-b801-429e-a899-0f2c17daf041 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:38.960413 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2b8e3970-b801-429e-a899-0f2c17daf041 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:38.961257 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2b8e3970-b801-429e-a899-0f2c17daf041 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:38.961760 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2b8e3970-b801-429e-a899-0f2c17daf041 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:39.317392 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-2b8e3970-b801-429e-a899-0f2c17daf041 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cd0aa08bfc4637a988f25eec8cfb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca59cfbe7f3b494499cc8efe1d0e093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:45:39.326414 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-2b8e3970-b801-429e-a899-0f2c17daf041 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] 10.222.0.38 "GET /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2" status: 200 len: 1580 microversion: 2.1 time: 0.380703 Feb 17 04:45:39.327052 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 477/959] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:45:38 2021] GET /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2 => generated 1580 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:45:40.347018 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-ec4636ce-5014-4033-9873-075b3f5c0b49 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:45:40.347787 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-ec4636ce-5014-4033-9873-075b3f5c0b49 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] [instance: e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:45:40.356703 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ec4636ce-5014-4033-9873-075b3f5c0b49 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:40.357207 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ec4636ce-5014-4033-9873-075b3f5c0b49 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:40.358041 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ec4636ce-5014-4033-9873-075b3f5c0b49 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:40.358532 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ec4636ce-5014-4033-9873-075b3f5c0b49 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:40.576339 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-ec4636ce-5014-4033-9873-075b3f5c0b49 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cd0aa08bfc4637a988f25eec8cfb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca59cfbe7f3b494499cc8efe1d0e093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:45:40.585227 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-ec4636ce-5014-4033-9873-075b3f5c0b49 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] 10.222.0.38 "GET /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2" status: 200 len: 1567 microversion: 2.1 time: 0.242677 Feb 17 04:45:40.585837 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 483/960] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:45:40 2021] GET /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2 => generated 1567 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:45:43.628606 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-482a3204-e06f-4e94-b47e-b360b158aad1 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:45:43.637102 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-482a3204-e06f-4e94-b47e-b360b158aad1 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:43.637617 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-482a3204-e06f-4e94-b47e-b360b158aad1 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:43.697152 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-482a3204-e06f-4e94-b47e-b360b158aad1 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: 486ab1d3-d971-40c2-aca6-4ce6ef472355] Going to try to stop instance {{(pid=98080) force_stop /opt/stack/nova/nova/compute/api.py:2580}} Feb 17 04:45:43.772272 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-482a3204-e06f-4e94-b47e-b360b158aad1 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "POST /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355/action" status: 202 len: 0 microversion: 2.1 time: 0.147498 Feb 17 04:45:43.772922 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 478/961] 10.222.0.38 () {60 vars in 1268 bytes} [Wed Feb 17 04:45:43 2021] POST /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355/action => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:45:43.782296 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-18fed5cd-cb7d-49d9-9db1-4f9a13c9fe39 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:45:43.782970 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-18fed5cd-cb7d-49d9-9db1-4f9a13c9fe39 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: 486ab1d3-d971-40c2-aca6-4ce6ef472355] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:45:43.791544 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-18fed5cd-cb7d-49d9-9db1-4f9a13c9fe39 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:43.792082 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-18fed5cd-cb7d-49d9-9db1-4f9a13c9fe39 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:43.792984 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-18fed5cd-cb7d-49d9-9db1-4f9a13c9fe39 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:43.793722 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-18fed5cd-cb7d-49d9-9db1-4f9a13c9fe39 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:44.008670 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-18fed5cd-cb7d-49d9-9db1-4f9a13c9fe39 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8b4cda0b044342ba470c32b33d0a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbfc8aedca448fab8273424e08aecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:45:44.018848 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-18fed5cd-cb7d-49d9-9db1-4f9a13c9fe39 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "GET /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355" status: 200 len: 1724 microversion: 2.1 time: 0.240757 Feb 17 04:45:44.019451 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 484/962] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:45:43 2021] GET /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355 => generated 1724 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:45:45.038529 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-a4207107-06c1-4b26-a68f-ca84b1c069db tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:45:45.039356 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-a4207107-06c1-4b26-a68f-ca84b1c069db tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: 486ab1d3-d971-40c2-aca6-4ce6ef472355] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:45:45.048403 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a4207107-06c1-4b26-a68f-ca84b1c069db tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:45.048913 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a4207107-06c1-4b26-a68f-ca84b1c069db tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:45.049746 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a4207107-06c1-4b26-a68f-ca84b1c069db tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:45.050236 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a4207107-06c1-4b26-a68f-ca84b1c069db tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:45.262450 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-a4207107-06c1-4b26-a68f-ca84b1c069db tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8b4cda0b044342ba470c32b33d0a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbfc8aedca448fab8273424e08aecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:45:45.271716 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-a4207107-06c1-4b26-a68f-ca84b1c069db tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "GET /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355" status: 200 len: 1724 microversion: 2.1 time: 0.237772 Feb 17 04:45:45.272322 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 479/963] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:45:45 2021] GET /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355 => generated 1724 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:45:46.289470 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-d92d7009-0904-42c4-9b15-b33b5a498c78 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:45:46.290062 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-d92d7009-0904-42c4-9b15-b33b5a498c78 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: 486ab1d3-d971-40c2-aca6-4ce6ef472355] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:45:46.299181 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d92d7009-0904-42c4-9b15-b33b5a498c78 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:46.299691 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d92d7009-0904-42c4-9b15-b33b5a498c78 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:46.300522 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d92d7009-0904-42c4-9b15-b33b5a498c78 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:46.301020 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d92d7009-0904-42c4-9b15-b33b5a498c78 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:46.514324 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-d92d7009-0904-42c4-9b15-b33b5a498c78 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8b4cda0b044342ba470c32b33d0a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbfc8aedca448fab8273424e08aecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:45:46.523802 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-d92d7009-0904-42c4-9b15-b33b5a498c78 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "GET /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355" status: 200 len: 1724 microversion: 2.1 time: 0.238380 Feb 17 04:45:46.524402 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 485/964] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:45:46 2021] GET /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355 => generated 1724 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:45:47.542913 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-5069bc0c-98af-4828-8d2e-9d4e86067858 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:45:47.543630 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-5069bc0c-98af-4828-8d2e-9d4e86067858 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: 486ab1d3-d971-40c2-aca6-4ce6ef472355] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:45:47.551394 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5069bc0c-98af-4828-8d2e-9d4e86067858 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:47.551898 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5069bc0c-98af-4828-8d2e-9d4e86067858 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:47.552726 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5069bc0c-98af-4828-8d2e-9d4e86067858 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:47.553213 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5069bc0c-98af-4828-8d2e-9d4e86067858 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:47.763341 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-5069bc0c-98af-4828-8d2e-9d4e86067858 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8b4cda0b044342ba470c32b33d0a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbfc8aedca448fab8273424e08aecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:45:47.772547 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-5069bc0c-98af-4828-8d2e-9d4e86067858 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "GET /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355" status: 200 len: 1724 microversion: 2.1 time: 0.234202 Feb 17 04:45:47.773144 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 480/965] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:45:47 2021] GET /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355 => generated 1724 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:45:48.792818 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-40376c9f-f742-4cd5-9864-d1a15aef50bd tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:45:48.793536 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-40376c9f-f742-4cd5-9864-d1a15aef50bd tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: 486ab1d3-d971-40c2-aca6-4ce6ef472355] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:45:48.801404 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-40376c9f-f742-4cd5-9864-d1a15aef50bd tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:48.801924 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-40376c9f-f742-4cd5-9864-d1a15aef50bd tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:48.802794 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-40376c9f-f742-4cd5-9864-d1a15aef50bd tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:48.803298 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-40376c9f-f742-4cd5-9864-d1a15aef50bd tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:49.018282 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-40376c9f-f742-4cd5-9864-d1a15aef50bd tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8b4cda0b044342ba470c32b33d0a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbfc8aedca448fab8273424e08aecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:45:49.028344 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-40376c9f-f742-4cd5-9864-d1a15aef50bd tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "GET /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355" status: 200 len: 1724 microversion: 2.1 time: 0.240416 Feb 17 04:45:49.028952 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 486/966] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:45:48 2021] GET /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355 => generated 1724 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:45:50.047381 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-59dbac92-0344-4fc6-9b87-d10f542148bf tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:45:50.048055 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-59dbac92-0344-4fc6-9b87-d10f542148bf tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: 486ab1d3-d971-40c2-aca6-4ce6ef472355] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:45:50.055962 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-59dbac92-0344-4fc6-9b87-d10f542148bf tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:50.056469 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-59dbac92-0344-4fc6-9b87-d10f542148bf tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:50.057308 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-59dbac92-0344-4fc6-9b87-d10f542148bf tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:50.059046 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-59dbac92-0344-4fc6-9b87-d10f542148bf tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:50.272153 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-59dbac92-0344-4fc6-9b87-d10f542148bf tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8b4cda0b044342ba470c32b33d0a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbfc8aedca448fab8273424e08aecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:45:50.281585 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-59dbac92-0344-4fc6-9b87-d10f542148bf tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "GET /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355" status: 200 len: 1724 microversion: 2.1 time: 0.238184 Feb 17 04:45:50.282179 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 481/967] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:45:50 2021] GET /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355 => generated 1724 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:45:51.301004 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-4a8a2871-a6d2-4519-9586-41120776bc93 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:45:51.301681 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-4a8a2871-a6d2-4519-9586-41120776bc93 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: 486ab1d3-d971-40c2-aca6-4ce6ef472355] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:45:51.310729 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4a8a2871-a6d2-4519-9586-41120776bc93 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:51.311238 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4a8a2871-a6d2-4519-9586-41120776bc93 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:51.312081 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4a8a2871-a6d2-4519-9586-41120776bc93 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:51.312586 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4a8a2871-a6d2-4519-9586-41120776bc93 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:51.519763 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-4a8a2871-a6d2-4519-9586-41120776bc93 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8b4cda0b044342ba470c32b33d0a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbfc8aedca448fab8273424e08aecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:45:51.529741 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-4a8a2871-a6d2-4519-9586-41120776bc93 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "GET /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355" status: 200 len: 1724 microversion: 2.1 time: 0.232753 Feb 17 04:45:51.530349 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 487/968] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:45:51 2021] GET /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355 => generated 1724 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:45:52.548816 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-292c7ec2-31ad-42e8-a491-0bcaa153deb4 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:45:52.549484 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-292c7ec2-31ad-42e8-a491-0bcaa153deb4 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: 486ab1d3-d971-40c2-aca6-4ce6ef472355] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:45:52.558431 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-292c7ec2-31ad-42e8-a491-0bcaa153deb4 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:52.559218 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-292c7ec2-31ad-42e8-a491-0bcaa153deb4 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:52.560058 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-292c7ec2-31ad-42e8-a491-0bcaa153deb4 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:52.560549 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-292c7ec2-31ad-42e8-a491-0bcaa153deb4 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:53.005147 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-292c7ec2-31ad-42e8-a491-0bcaa153deb4 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8b4cda0b044342ba470c32b33d0a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbfc8aedca448fab8273424e08aecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:45:53.014599 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-292c7ec2-31ad-42e8-a491-0bcaa153deb4 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "GET /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355" status: 200 len: 1724 microversion: 2.1 time: 0.469814 Feb 17 04:45:53.015194 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 482/969] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:45:52 2021] GET /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355 => generated 1724 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:45:54.033605 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-33938ce1-1628-4c15-bdf1-81ad700599c7 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:45:54.034278 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-33938ce1-1628-4c15-bdf1-81ad700599c7 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: 486ab1d3-d971-40c2-aca6-4ce6ef472355] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:45:54.042162 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-33938ce1-1628-4c15-bdf1-81ad700599c7 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:54.042792 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-33938ce1-1628-4c15-bdf1-81ad700599c7 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:54.043634 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-33938ce1-1628-4c15-bdf1-81ad700599c7 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:54.044136 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-33938ce1-1628-4c15-bdf1-81ad700599c7 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:54.255003 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-33938ce1-1628-4c15-bdf1-81ad700599c7 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8b4cda0b044342ba470c32b33d0a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbfc8aedca448fab8273424e08aecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:45:54.265145 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-33938ce1-1628-4c15-bdf1-81ad700599c7 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "GET /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355" status: 200 len: 1724 microversion: 2.1 time: 0.235553 Feb 17 04:45:54.265748 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 488/970] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:45:54 2021] GET /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355 => generated 1724 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:45:55.283523 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-f653ca64-5e88-4650-a582-3607ab66ff15 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:45:55.284216 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-f653ca64-5e88-4650-a582-3607ab66ff15 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: 486ab1d3-d971-40c2-aca6-4ce6ef472355] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:45:55.292063 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f653ca64-5e88-4650-a582-3607ab66ff15 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:55.292611 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f653ca64-5e88-4650-a582-3607ab66ff15 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:55.293818 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f653ca64-5e88-4650-a582-3607ab66ff15 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:55.294386 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f653ca64-5e88-4650-a582-3607ab66ff15 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:55.507495 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-f653ca64-5e88-4650-a582-3607ab66ff15 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8b4cda0b044342ba470c32b33d0a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbfc8aedca448fab8273424e08aecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:45:55.516825 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-f653ca64-5e88-4650-a582-3607ab66ff15 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "GET /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355" status: 200 len: 1724 microversion: 2.1 time: 0.237402 Feb 17 04:45:55.517415 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 483/971] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:45:55 2021] GET /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355 => generated 1724 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:45:56.534873 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-a8c393dd-cacf-4c5e-a22c-0e4677fe0616 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:45:56.535536 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-a8c393dd-cacf-4c5e-a22c-0e4677fe0616 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: 486ab1d3-d971-40c2-aca6-4ce6ef472355] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:45:56.543877 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a8c393dd-cacf-4c5e-a22c-0e4677fe0616 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:56.544384 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a8c393dd-cacf-4c5e-a22c-0e4677fe0616 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:56.545214 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a8c393dd-cacf-4c5e-a22c-0e4677fe0616 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:56.545702 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a8c393dd-cacf-4c5e-a22c-0e4677fe0616 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:56.761634 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-a8c393dd-cacf-4c5e-a22c-0e4677fe0616 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8b4cda0b044342ba470c32b33d0a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbfc8aedca448fab8273424e08aecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:45:56.771058 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-a8c393dd-cacf-4c5e-a22c-0e4677fe0616 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "GET /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355" status: 200 len: 1724 microversion: 2.1 time: 0.240224 Feb 17 04:45:56.771653 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 489/972] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:45:56 2021] GET /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355 => generated 1724 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:45:57.789455 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-d05ed415-fb9b-45be-99cc-68df055d0510 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:45:57.790127 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-d05ed415-fb9b-45be-99cc-68df055d0510 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: 486ab1d3-d971-40c2-aca6-4ce6ef472355] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:45:57.798970 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d05ed415-fb9b-45be-99cc-68df055d0510 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:57.799485 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d05ed415-fb9b-45be-99cc-68df055d0510 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:57.800322 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d05ed415-fb9b-45be-99cc-68df055d0510 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:57.800823 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d05ed415-fb9b-45be-99cc-68df055d0510 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:58.012584 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-d05ed415-fb9b-45be-99cc-68df055d0510 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8b4cda0b044342ba470c32b33d0a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbfc8aedca448fab8273424e08aecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:45:58.022381 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-d05ed415-fb9b-45be-99cc-68df055d0510 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "GET /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355" status: 200 len: 1724 microversion: 2.1 time: 0.236789 Feb 17 04:45:58.023146 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 484/973] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:45:57 2021] GET /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355 => generated 1724 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:45:59.040141 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-ad19b221-b034-4550-bc9d-a78d49599cbd tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:45:59.040867 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-ad19b221-b034-4550-bc9d-a78d49599cbd tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: 486ab1d3-d971-40c2-aca6-4ce6ef472355] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:45:59.049039 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ad19b221-b034-4550-bc9d-a78d49599cbd tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:59.049605 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ad19b221-b034-4550-bc9d-a78d49599cbd tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:59.050444 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ad19b221-b034-4550-bc9d-a78d49599cbd tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:45:59.050969 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ad19b221-b034-4550-bc9d-a78d49599cbd tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:45:59.268829 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-ad19b221-b034-4550-bc9d-a78d49599cbd tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8b4cda0b044342ba470c32b33d0a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbfc8aedca448fab8273424e08aecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:45:59.278344 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-ad19b221-b034-4550-bc9d-a78d49599cbd tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "GET /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355" status: 200 len: 1724 microversion: 2.1 time: 0.242234 Feb 17 04:45:59.278978 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 490/974] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:45:59 2021] GET /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355 => generated 1724 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:46:00.297212 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-a023ff24-f94d-48a1-8289-66a23a1d8a51 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:46:00.297817 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-a023ff24-f94d-48a1-8289-66a23a1d8a51 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: 486ab1d3-d971-40c2-aca6-4ce6ef472355] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:46:00.305723 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a023ff24-f94d-48a1-8289-66a23a1d8a51 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:00.306232 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a023ff24-f94d-48a1-8289-66a23a1d8a51 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:00.307105 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a023ff24-f94d-48a1-8289-66a23a1d8a51 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:00.308001 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a023ff24-f94d-48a1-8289-66a23a1d8a51 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:00.525286 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-a023ff24-f94d-48a1-8289-66a23a1d8a51 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8b4cda0b044342ba470c32b33d0a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbfc8aedca448fab8273424e08aecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:46:00.535165 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-a023ff24-f94d-48a1-8289-66a23a1d8a51 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "GET /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355" status: 200 len: 1701 microversion: 2.1 time: 0.242036 Feb 17 04:46:00.535764 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 485/975] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:46:00 2021] GET /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355 => generated 1701 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:46:00.553262 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-01962e6b-b561-44b1-8ffd-5bfcdfd2ee4c tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:46:00.562448 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-01962e6b-b561-44b1-8ffd-5bfcdfd2ee4c tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:00.563031 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-01962e6b-b561-44b1-8ffd-5bfcdfd2ee4c tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:00.623740 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-01962e6b-b561-44b1-8ffd-5bfcdfd2ee4c tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: 486ab1d3-d971-40c2-aca6-4ce6ef472355] Going to try to start instance {{(pid=98081) start /opt/stack/nova/nova/compute/api.py:2603}} Feb 17 04:46:00.703624 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-01962e6b-b561-44b1-8ffd-5bfcdfd2ee4c tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "POST /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355/action" status: 202 len: 0 microversion: 2.1 time: 0.154100 Feb 17 04:46:00.704352 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 491/976] 10.222.0.38 () {60 vars in 1268 bytes} [Wed Feb 17 04:46:00 2021] POST /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355/action => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:46:00.713003 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-5477b670-1bdb-40e9-aabb-385e44916c59 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:46:00.713877 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-5477b670-1bdb-40e9-aabb-385e44916c59 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: 486ab1d3-d971-40c2-aca6-4ce6ef472355] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:46:00.722064 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5477b670-1bdb-40e9-aabb-385e44916c59 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:00.722610 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5477b670-1bdb-40e9-aabb-385e44916c59 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:00.723476 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5477b670-1bdb-40e9-aabb-385e44916c59 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:00.723979 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5477b670-1bdb-40e9-aabb-385e44916c59 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:01.028967 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-5477b670-1bdb-40e9-aabb-385e44916c59 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8b4cda0b044342ba470c32b33d0a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbfc8aedca448fab8273424e08aecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:46:01.038395 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-5477b670-1bdb-40e9-aabb-385e44916c59 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "GET /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355" status: 200 len: 1710 microversion: 2.1 time: 0.329406 Feb 17 04:46:01.039035 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 486/977] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:46:00 2021] GET /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355 => generated 1710 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:46:02.057886 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-173dae41-e341-46a9-b0dd-50bc95d87dbe tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:46:02.058968 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-173dae41-e341-46a9-b0dd-50bc95d87dbe tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: 486ab1d3-d971-40c2-aca6-4ce6ef472355] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:46:02.067324 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-173dae41-e341-46a9-b0dd-50bc95d87dbe tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:02.067841 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-173dae41-e341-46a9-b0dd-50bc95d87dbe tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:02.068692 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-173dae41-e341-46a9-b0dd-50bc95d87dbe tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:02.069194 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-173dae41-e341-46a9-b0dd-50bc95d87dbe tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:02.277667 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-173dae41-e341-46a9-b0dd-50bc95d87dbe tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8b4cda0b044342ba470c32b33d0a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbfc8aedca448fab8273424e08aecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:46:02.287094 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-173dae41-e341-46a9-b0dd-50bc95d87dbe tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "GET /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355" status: 200 len: 1710 microversion: 2.1 time: 0.233690 Feb 17 04:46:02.287725 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 492/978] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:46:02 2021] GET /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355 => generated 1710 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:46:03.306494 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-2b30d549-a0c6-4d97-be75-8253e2cbd2ef tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:46:03.307233 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-2b30d549-a0c6-4d97-be75-8253e2cbd2ef tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: 486ab1d3-d971-40c2-aca6-4ce6ef472355] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:46:03.315893 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2b30d549-a0c6-4d97-be75-8253e2cbd2ef tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:03.316414 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2b30d549-a0c6-4d97-be75-8253e2cbd2ef tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:03.317255 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2b30d549-a0c6-4d97-be75-8253e2cbd2ef tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:03.317764 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2b30d549-a0c6-4d97-be75-8253e2cbd2ef tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:03.530140 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-2b30d549-a0c6-4d97-be75-8253e2cbd2ef tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8b4cda0b044342ba470c32b33d0a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbfc8aedca448fab8273424e08aecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:46:03.539411 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-2b30d549-a0c6-4d97-be75-8253e2cbd2ef tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "GET /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355" status: 200 len: 1714 microversion: 2.1 time: 0.236967 Feb 17 04:46:03.540002 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 487/979] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:46:03 2021] GET /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355 => generated 1714 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:46:36.845366 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-2a435a7a-d761-47b7-b13a-eefe8a7ecdc1 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:46:36.845959 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-2a435a7a-d761-47b7-b13a-eefe8a7ecdc1 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: 486ab1d3-d971-40c2-aca6-4ce6ef472355] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:46:36.854041 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2a435a7a-d761-47b7-b13a-eefe8a7ecdc1 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:36.854553 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2a435a7a-d761-47b7-b13a-eefe8a7ecdc1 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:36.855434 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2a435a7a-d761-47b7-b13a-eefe8a7ecdc1 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:36.857119 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2a435a7a-d761-47b7-b13a-eefe8a7ecdc1 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:37.142147 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.objects.instance [None req-2a435a7a-d761-47b7-b13a-eefe8a7ecdc1 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lazy-loading 'services' on Instance uuid 486ab1d3-d971-40c2-aca6-4ce6ef472355 {{(pid=98081) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:46:37.285602 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-2a435a7a-d761-47b7-b13a-eefe8a7ecdc1 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "DELETE /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355/os-volume_attachments/feda2408-a80f-449b-a3ba-8732877a2fc5" status: 202 len: 0 microversion: 2.1 time: 0.445180 Feb 17 04:46:37.286238 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 493/980] 10.222.0.38 () {58 vars in 1406 bytes} [Wed Feb 17 04:46:36 2021] DELETE /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355/os-volume_attachments/feda2408-a80f-449b-a3ba-8732877a2fc5 => generated 0 bytes in 447 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:46:38.497375 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-cda1df2e-0003-4c4f-88fd-8ff2d4084a0c tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:46:38.505595 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-cda1df2e-0003-4c4f-88fd-8ff2d4084a0c tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:38.506110 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-cda1df2e-0003-4c4f-88fd-8ff2d4084a0c tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:38.569506 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-cda1df2e-0003-4c4f-88fd-8ff2d4084a0c tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: 486ab1d3-d971-40c2-aca6-4ce6ef472355] Going to try to stop instance {{(pid=98080) force_stop /opt/stack/nova/nova/compute/api.py:2580}} Feb 17 04:46:38.647406 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-cda1df2e-0003-4c4f-88fd-8ff2d4084a0c tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "POST /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355/action" status: 202 len: 0 microversion: 2.1 time: 0.154428 Feb 17 04:46:38.648070 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 488/981] 10.222.0.38 () {60 vars in 1268 bytes} [Wed Feb 17 04:46:38 2021] POST /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355/action => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:46:38.658118 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-c9263364-19f7-4e7a-91c0-decec01ae247 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:46:38.658909 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-c9263364-19f7-4e7a-91c0-decec01ae247 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: 486ab1d3-d971-40c2-aca6-4ce6ef472355] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:46:38.667534 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c9263364-19f7-4e7a-91c0-decec01ae247 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:38.668203 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c9263364-19f7-4e7a-91c0-decec01ae247 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:38.669007 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c9263364-19f7-4e7a-91c0-decec01ae247 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:38.669505 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c9263364-19f7-4e7a-91c0-decec01ae247 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:39.020267 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-c9263364-19f7-4e7a-91c0-decec01ae247 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8b4cda0b044342ba470c32b33d0a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbfc8aedca448fab8273424e08aecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:46:39.030154 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-c9263364-19f7-4e7a-91c0-decec01ae247 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "GET /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355" status: 200 len: 1678 microversion: 2.1 time: 0.376765 Feb 17 04:46:39.030807 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 494/982] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:46:38 2021] GET /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355 => generated 1678 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:46:40.049456 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-64a2160c-c3fd-4a3a-8baf-12028793a82a tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:46:40.050230 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-64a2160c-c3fd-4a3a-8baf-12028793a82a tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: 486ab1d3-d971-40c2-aca6-4ce6ef472355] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:46:40.058367 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-64a2160c-c3fd-4a3a-8baf-12028793a82a tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:40.059204 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-64a2160c-c3fd-4a3a-8baf-12028793a82a tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:40.060140 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-64a2160c-c3fd-4a3a-8baf-12028793a82a tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:40.060645 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-64a2160c-c3fd-4a3a-8baf-12028793a82a tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:40.319538 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-64a2160c-c3fd-4a3a-8baf-12028793a82a tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8b4cda0b044342ba470c32b33d0a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbfc8aedca448fab8273424e08aecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:46:40.328880 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-64a2160c-c3fd-4a3a-8baf-12028793a82a tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "GET /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355" status: 200 len: 1678 microversion: 2.1 time: 0.283894 Feb 17 04:46:40.329473 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 489/983] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:46:40 2021] GET /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355 => generated 1678 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:46:41.347727 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-1b954281-d7da-4ab8-bcc3-a62046179de7 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:46:41.348488 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-1b954281-d7da-4ab8-bcc3-a62046179de7 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: 486ab1d3-d971-40c2-aca6-4ce6ef472355] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:46:41.356711 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1b954281-d7da-4ab8-bcc3-a62046179de7 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:41.357223 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1b954281-d7da-4ab8-bcc3-a62046179de7 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:41.358064 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1b954281-d7da-4ab8-bcc3-a62046179de7 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:41.358597 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1b954281-d7da-4ab8-bcc3-a62046179de7 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:41.572483 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-1b954281-d7da-4ab8-bcc3-a62046179de7 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8b4cda0b044342ba470c32b33d0a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbfc8aedca448fab8273424e08aecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:46:41.581186 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-1b954281-d7da-4ab8-bcc3-a62046179de7 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "GET /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355" status: 200 len: 1678 microversion: 2.1 time: 0.237816 Feb 17 04:46:41.581781 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 495/984] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:46:41 2021] GET /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355 => generated 1678 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:46:42.600109 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-b31fcf28-47e3-42fa-a175-a1818f83fff2 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:46:42.600776 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-b31fcf28-47e3-42fa-a175-a1818f83fff2 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: 486ab1d3-d971-40c2-aca6-4ce6ef472355] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:46:42.608799 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b31fcf28-47e3-42fa-a175-a1818f83fff2 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:42.609303 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b31fcf28-47e3-42fa-a175-a1818f83fff2 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:42.610138 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b31fcf28-47e3-42fa-a175-a1818f83fff2 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:42.610652 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b31fcf28-47e3-42fa-a175-a1818f83fff2 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:42.825535 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-b31fcf28-47e3-42fa-a175-a1818f83fff2 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8b4cda0b044342ba470c32b33d0a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbfc8aedca448fab8273424e08aecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:46:42.834279 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-b31fcf28-47e3-42fa-a175-a1818f83fff2 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "GET /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355" status: 200 len: 1678 microversion: 2.1 time: 0.238244 Feb 17 04:46:42.834935 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 490/985] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:46:42 2021] GET /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355 => generated 1678 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:46:43.853264 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-710a1948-debc-4381-a531-be9da9b10229 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:46:43.853940 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-710a1948-debc-4381-a531-be9da9b10229 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: 486ab1d3-d971-40c2-aca6-4ce6ef472355] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:46:43.862696 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-710a1948-debc-4381-a531-be9da9b10229 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:43.863215 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-710a1948-debc-4381-a531-be9da9b10229 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:43.864062 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-710a1948-debc-4381-a531-be9da9b10229 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:43.864561 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-710a1948-debc-4381-a531-be9da9b10229 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:44.080938 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-710a1948-debc-4381-a531-be9da9b10229 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8b4cda0b044342ba470c32b33d0a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbfc8aedca448fab8273424e08aecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:46:44.089784 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-710a1948-debc-4381-a531-be9da9b10229 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "GET /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355" status: 200 len: 1678 microversion: 2.1 time: 0.240484 Feb 17 04:46:44.090395 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 496/986] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:46:43 2021] GET /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355 => generated 1678 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:46:45.110131 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-912ee618-7355-4e63-b8c9-f42b8841ea79 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:46:45.110825 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-912ee618-7355-4e63-b8c9-f42b8841ea79 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: 486ab1d3-d971-40c2-aca6-4ce6ef472355] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:46:45.118584 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-912ee618-7355-4e63-b8c9-f42b8841ea79 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:45.119112 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-912ee618-7355-4e63-b8c9-f42b8841ea79 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:45.119952 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-912ee618-7355-4e63-b8c9-f42b8841ea79 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:45.120444 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-912ee618-7355-4e63-b8c9-f42b8841ea79 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:45.334106 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-912ee618-7355-4e63-b8c9-f42b8841ea79 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8b4cda0b044342ba470c32b33d0a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbfc8aedca448fab8273424e08aecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:46:45.343609 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-912ee618-7355-4e63-b8c9-f42b8841ea79 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "GET /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355" status: 200 len: 1678 microversion: 2.1 time: 0.238052 Feb 17 04:46:45.344222 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 491/987] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:46:45 2021] GET /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355 => generated 1678 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:46:46.362171 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-fd47732e-fb65-4c42-a39e-2bd6fbd471e1 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:46:46.362869 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-fd47732e-fb65-4c42-a39e-2bd6fbd471e1 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: 486ab1d3-d971-40c2-aca6-4ce6ef472355] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:46:46.370663 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-fd47732e-fb65-4c42-a39e-2bd6fbd471e1 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:46.371294 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-fd47732e-fb65-4c42-a39e-2bd6fbd471e1 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:46.372137 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-fd47732e-fb65-4c42-a39e-2bd6fbd471e1 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:46.372626 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-fd47732e-fb65-4c42-a39e-2bd6fbd471e1 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:46.592015 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-fd47732e-fb65-4c42-a39e-2bd6fbd471e1 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8b4cda0b044342ba470c32b33d0a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbfc8aedca448fab8273424e08aecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:46:46.600900 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-fd47732e-fb65-4c42-a39e-2bd6fbd471e1 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "GET /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355" status: 200 len: 1678 microversion: 2.1 time: 0.242916 Feb 17 04:46:46.601502 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 497/988] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:46:46 2021] GET /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355 => generated 1678 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:46:47.620145 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-a1589036-c45d-4f82-8e52-a6a1562f810a tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:46:47.621376 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-a1589036-c45d-4f82-8e52-a6a1562f810a tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: 486ab1d3-d971-40c2-aca6-4ce6ef472355] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:46:47.629287 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a1589036-c45d-4f82-8e52-a6a1562f810a tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:47.629794 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a1589036-c45d-4f82-8e52-a6a1562f810a tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:47.630643 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a1589036-c45d-4f82-8e52-a6a1562f810a tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:47.631138 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a1589036-c45d-4f82-8e52-a6a1562f810a tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:47.836403 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-a1589036-c45d-4f82-8e52-a6a1562f810a tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8b4cda0b044342ba470c32b33d0a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbfc8aedca448fab8273424e08aecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:46:47.845305 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-a1589036-c45d-4f82-8e52-a6a1562f810a tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "GET /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355" status: 200 len: 1678 microversion: 2.1 time: 0.229242 Feb 17 04:46:47.845899 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 492/989] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:46:47 2021] GET /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355 => generated 1678 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:46:48.864338 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-b834bfb0-b9d7-4f63-9c66-43a3f7885197 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:46:48.865005 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-b834bfb0-b9d7-4f63-9c66-43a3f7885197 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: 486ab1d3-d971-40c2-aca6-4ce6ef472355] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:46:48.873156 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b834bfb0-b9d7-4f63-9c66-43a3f7885197 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:48.873673 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b834bfb0-b9d7-4f63-9c66-43a3f7885197 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:48.874524 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b834bfb0-b9d7-4f63-9c66-43a3f7885197 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:48.875063 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b834bfb0-b9d7-4f63-9c66-43a3f7885197 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:49.091966 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-b834bfb0-b9d7-4f63-9c66-43a3f7885197 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8b4cda0b044342ba470c32b33d0a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbfc8aedca448fab8273424e08aecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:46:49.100904 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-b834bfb0-b9d7-4f63-9c66-43a3f7885197 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "GET /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355" status: 200 len: 1678 microversion: 2.1 time: 0.240545 Feb 17 04:46:49.101514 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 498/990] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:46:48 2021] GET /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355 => generated 1678 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:46:50.119881 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-dbf3c0ed-05ba-4c5c-ab7c-d92056e62d70 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:46:50.120552 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-dbf3c0ed-05ba-4c5c-ab7c-d92056e62d70 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: 486ab1d3-d971-40c2-aca6-4ce6ef472355] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:46:50.128582 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-dbf3c0ed-05ba-4c5c-ab7c-d92056e62d70 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:50.129089 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-dbf3c0ed-05ba-4c5c-ab7c-d92056e62d70 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:50.129923 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-dbf3c0ed-05ba-4c5c-ab7c-d92056e62d70 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:50.130411 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-dbf3c0ed-05ba-4c5c-ab7c-d92056e62d70 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:50.342913 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-dbf3c0ed-05ba-4c5c-ab7c-d92056e62d70 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8b4cda0b044342ba470c32b33d0a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbfc8aedca448fab8273424e08aecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:46:50.351787 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-dbf3c0ed-05ba-4c5c-ab7c-d92056e62d70 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "GET /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355" status: 200 len: 1655 microversion: 2.1 time: 0.235961 Feb 17 04:46:50.352390 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 493/991] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:46:50 2021] GET /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355 => generated 1655 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:46:50.369405 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-476728b3-7788-4e6d-944c-a5a31111f24f tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:46:50.378085 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-476728b3-7788-4e6d-944c-a5a31111f24f tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:50.378660 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-476728b3-7788-4e6d-944c-a5a31111f24f tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:50.437814 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-476728b3-7788-4e6d-944c-a5a31111f24f tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: 486ab1d3-d971-40c2-aca6-4ce6ef472355] Going to try to start instance {{(pid=98081) start /opt/stack/nova/nova/compute/api.py:2603}} Feb 17 04:46:50.517769 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-476728b3-7788-4e6d-944c-a5a31111f24f tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "POST /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355/action" status: 202 len: 0 microversion: 2.1 time: 0.152155 Feb 17 04:46:50.518539 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 499/992] 10.222.0.38 () {60 vars in 1268 bytes} [Wed Feb 17 04:46:50 2021] POST /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355/action => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:46:50.527561 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-88de0ee8-4327-48be-b3c4-d0fb262f990e tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:46:50.528266 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-88de0ee8-4327-48be-b3c4-d0fb262f990e tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: 486ab1d3-d971-40c2-aca6-4ce6ef472355] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:46:50.536311 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-88de0ee8-4327-48be-b3c4-d0fb262f990e tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:50.536839 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-88de0ee8-4327-48be-b3c4-d0fb262f990e tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:50.537699 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-88de0ee8-4327-48be-b3c4-d0fb262f990e tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:50.538199 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-88de0ee8-4327-48be-b3c4-d0fb262f990e tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:50.909318 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-88de0ee8-4327-48be-b3c4-d0fb262f990e tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8b4cda0b044342ba470c32b33d0a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbfc8aedca448fab8273424e08aecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:46:50.919277 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-88de0ee8-4327-48be-b3c4-d0fb262f990e tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "GET /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355" status: 200 len: 1664 microversion: 2.1 time: 0.395976 Feb 17 04:46:50.919887 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 494/993] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:46:50 2021] GET /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355 => generated 1664 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:46:51.939877 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-dd2925b0-b3d9-48fd-973f-6bf73ad198ac tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:46:51.940626 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-dd2925b0-b3d9-48fd-973f-6bf73ad198ac tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: 486ab1d3-d971-40c2-aca6-4ce6ef472355] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:46:51.949603 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-dd2925b0-b3d9-48fd-973f-6bf73ad198ac tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:51.951208 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-dd2925b0-b3d9-48fd-973f-6bf73ad198ac tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:51.952074 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-dd2925b0-b3d9-48fd-973f-6bf73ad198ac tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:51.952575 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-dd2925b0-b3d9-48fd-973f-6bf73ad198ac tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:52.166901 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-dd2925b0-b3d9-48fd-973f-6bf73ad198ac tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8b4cda0b044342ba470c32b33d0a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbfc8aedca448fab8273424e08aecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:46:52.176313 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-dd2925b0-b3d9-48fd-973f-6bf73ad198ac tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "GET /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355" status: 200 len: 1664 microversion: 2.1 time: 0.241085 Feb 17 04:46:52.176918 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 500/994] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:46:51 2021] GET /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355 => generated 1664 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:46:53.196250 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-c1fb12cb-e9f9-46b5-bc5d-1f170e39ef7e tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:46:53.196921 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-c1fb12cb-e9f9-46b5-bc5d-1f170e39ef7e tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: 486ab1d3-d971-40c2-aca6-4ce6ef472355] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:46:53.204950 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c1fb12cb-e9f9-46b5-bc5d-1f170e39ef7e tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:53.205459 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c1fb12cb-e9f9-46b5-bc5d-1f170e39ef7e tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:53.206286 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c1fb12cb-e9f9-46b5-bc5d-1f170e39ef7e tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:53.206811 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c1fb12cb-e9f9-46b5-bc5d-1f170e39ef7e tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:53.415240 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-c1fb12cb-e9f9-46b5-bc5d-1f170e39ef7e tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8b4cda0b044342ba470c32b33d0a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbfc8aedca448fab8273424e08aecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:46:53.424468 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-c1fb12cb-e9f9-46b5-bc5d-1f170e39ef7e tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "GET /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355" status: 200 len: 1668 microversion: 2.1 time: 0.232256 Feb 17 04:46:53.425067 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 495/995] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:46:53 2021] GET /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355 => generated 1668 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:46:53.888758 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-a2db160f-ec83-4e7d-8333-edc4dcfb58af tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Calling method '.version_select at 0x7fc2e9d5b840>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:46:54.388699 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-a2db160f-ec83-4e7d-8333-edc4dcfb58af tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] [instance: e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:46:54.397340 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a2db160f-ec83-4e7d-8333-edc4dcfb58af tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:54.397862 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a2db160f-ec83-4e7d-8333-edc4dcfb58af tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:54.398753 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a2db160f-ec83-4e7d-8333-edc4dcfb58af tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:54.399257 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a2db160f-ec83-4e7d-8333-edc4dcfb58af tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:54.461085 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a2db160f-ec83-4e7d-8333-edc4dcfb58af tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Acquired lock "refresh_cache-e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2" {{(pid=98081) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Feb 17 04:46:56.166533 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.network.neutron [None req-a2db160f-ec83-4e7d-8333-edc4dcfb58af tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] [instance: e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2] Building network info cache for instance {{(pid=98081) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1836}} Feb 17 04:46:56.235074 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [req-f7ea070b-b1ea-4345-8d7e-ed2270f0613e req-125e4dc7-2be7-463e-b54d-ad062e8940e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2", "tag": "6738a807-1bee-443c-9281-dcce36604367"}]} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:46:56.236945 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:46:56.236945 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:46:56.247018 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-f7ea070b-b1ea-4345-8d7e-ed2270f0613e req-125e4dc7-2be7-463e-b54d-ad062e8940e8 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:56.247528 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-f7ea070b-b1ea-4345-8d7e-ed2270f0613e req-125e4dc7-2be7-463e-b54d-ad062e8940e8 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:56.265399 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.compute.server_external_events [req-f7ea070b-b1ea-4345-8d7e-ed2270f0613e req-125e4dc7-2be7-463e-b54d-ad062e8940e8 service nova] Creating event network-changed:6738a807-1bee-443c-9281-dcce36604367 for instance e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2 on hv-cinder-76019 Feb 17 04:46:56.270749 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [req-f7ea070b-b1ea-4345-8d7e-ed2270f0613e req-125e4dc7-2be7-463e-b54d-ad062e8940e8 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098338 Feb 17 04:46:56.271632 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 496/996] 10.222.0.38 () {64 vars in 1308 bytes} [Wed Feb 17 04:46:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:46:57.722233 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.network.neutron [None req-a2db160f-ec83-4e7d-8333-edc4dcfb58af tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] [instance: e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2] Updating instance_info_cache with network_info: [{"id": "6738a807-1bee-443c-9281-dcce36604367", "address": "fa:16:3e:a0:4b:ec", "network": {"id": "3468340d-819b-4c91-9b3c-03f43d53a90d", "bridge": "br-int", "label": "tempest-TestShelveInstance-2100110560-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "ca59cfbe7f3b494499cc8efe1d0e093e", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tap6738a807-1b", "ovs_interfaceid": "6738a807-1bee-443c-9281-dcce36604367", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=98081) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Feb 17 04:46:57.732639 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a2db160f-ec83-4e7d-8333-edc4dcfb58af tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Releasing lock "refresh_cache-e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2" {{(pid=98081) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Feb 17 04:46:57.733574 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-a2db160f-ec83-4e7d-8333-edc4dcfb58af tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] 10.222.0.38 "DELETE /compute/v2.1/os-floating-ips/715c95a8-3dd9-4e17-8567-07390548c679" status: 202 len: 0 microversion: 2.1 time: 3.849537 Feb 17 04:46:57.734223 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 501/997] 10.222.0.38 () {58 vars in 1253 bytes} [Wed Feb 17 04:46:53 2021] DELETE /compute/v2.1/os-floating-ips/715c95a8-3dd9-4e17-8567-07390548c679 => generated 0 bytes in 3851 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:46:57.743496 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-1f063d5e-d205-4956-86a8-1b61b7b3b11e tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:46:57.744146 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-1f063d5e-d205-4956-86a8-1b61b7b3b11e tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] [instance: e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:46:57.752834 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1f063d5e-d205-4956-86a8-1b61b7b3b11e tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:57.753340 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1f063d5e-d205-4956-86a8-1b61b7b3b11e tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:57.754179 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1f063d5e-d205-4956-86a8-1b61b7b3b11e tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:57.754696 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-1f063d5e-d205-4956-86a8-1b61b7b3b11e tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:57.824425 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-1f063d5e-d205-4956-86a8-1b61b7b3b11e tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] [instance: e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2] Going to try to terminate instance {{(pid=98080) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 04:46:57.941058 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-1f063d5e-d205-4956-86a8-1b61b7b3b11e tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] 10.222.0.38 "DELETE /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2" status: 204 len: 0 microversion: 2.1 time: 0.201742 Feb 17 04:46:57.941833 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 497/998] 10.222.0.38 () {58 vars in 1229 bytes} [Wed Feb 17 04:46:57 2021] DELETE /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 17 04:46:57.950736 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-ad381b62-96ba-4d63-a22f-96ae2343a688 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:46:57.951418 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-ad381b62-96ba-4d63-a22f-96ae2343a688 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] [instance: e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:46:57.959476 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ad381b62-96ba-4d63-a22f-96ae2343a688 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:57.959984 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ad381b62-96ba-4d63-a22f-96ae2343a688 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:57.960822 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ad381b62-96ba-4d63-a22f-96ae2343a688 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:57.961358 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ad381b62-96ba-4d63-a22f-96ae2343a688 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:58.197380 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-ad381b62-96ba-4d63-a22f-96ae2343a688 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cd0aa08bfc4637a988f25eec8cfb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca59cfbe7f3b494499cc8efe1d0e093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:46:58.207167 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-ad381b62-96ba-4d63-a22f-96ae2343a688 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] 10.222.0.38 "GET /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2" status: 200 len: 1454 microversion: 2.1 time: 0.260492 Feb 17 04:46:58.207768 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 502/999] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:46:57 2021] GET /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2 => generated 1454 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:46:59.227261 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-4fdc6583-0723-4005-9135-036c310c7c0d tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:46:59.228054 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-4fdc6583-0723-4005-9135-036c310c7c0d tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] [instance: e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:46:59.236351 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4fdc6583-0723-4005-9135-036c310c7c0d tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:59.236854 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4fdc6583-0723-4005-9135-036c310c7c0d tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:59.237683 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4fdc6583-0723-4005-9135-036c310c7c0d tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:46:59.238174 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4fdc6583-0723-4005-9135-036c310c7c0d tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:46:59.452895 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-4fdc6583-0723-4005-9135-036c310c7c0d tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cd0aa08bfc4637a988f25eec8cfb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca59cfbe7f3b494499cc8efe1d0e093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:46:59.461675 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-4fdc6583-0723-4005-9135-036c310c7c0d tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] 10.222.0.38 "GET /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2" status: 200 len: 1454 microversion: 2.1 time: 0.239072 Feb 17 04:46:59.462279 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 498/1000] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:46:59 2021] GET /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2 => generated 1454 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:47:00.450377 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [req-e8abfdf1-0e7d-4787-89c5-660bd6b47e7f req-62dd875f-014a-4d78-9bb9-2cf1e6ec954d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2", "name": "network-vif-deleted", "tag": "6738a807-1bee-443c-9281-dcce36604367"}]} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:47:00.452331 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:47:00.452331 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:47:00.461218 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-e8abfdf1-0e7d-4787-89c5-660bd6b47e7f req-62dd875f-014a-4d78-9bb9-2cf1e6ec954d service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:47:00.461710 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-e8abfdf1-0e7d-4787-89c5-660bd6b47e7f req-62dd875f-014a-4d78-9bb9-2cf1e6ec954d service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:47:00.485810 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-d4dacc4a-b01a-4472-be14-958068a7a111 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:47:00.487150 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-d4dacc4a-b01a-4472-be14-958068a7a111 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] [instance: e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:47:00.487432 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.compute.server_external_events [req-e8abfdf1-0e7d-4787-89c5-660bd6b47e7f req-62dd875f-014a-4d78-9bb9-2cf1e6ec954d service nova] Creating event network-vif-deleted:6738a807-1bee-443c-9281-dcce36604367 for instance e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2 on hv-cinder-76019 Feb 17 04:47:00.493828 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [req-e8abfdf1-0e7d-4787-89c5-660bd6b47e7f req-62dd875f-014a-4d78-9bb9-2cf1e6ec954d service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046877 Feb 17 04:47:00.494099 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 503/1001] 10.222.0.38 () {64 vars in 1308 bytes} [Wed Feb 17 04:47:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:47:00.498261 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d4dacc4a-b01a-4472-be14-958068a7a111 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:47:00.498805 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d4dacc4a-b01a-4472-be14-958068a7a111 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:47:00.499656 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d4dacc4a-b01a-4472-be14-958068a7a111 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:47:00.500145 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d4dacc4a-b01a-4472-be14-958068a7a111 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:47:00.652010 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-d4dacc4a-b01a-4472-be14-958068a7a111 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82cd0aa08bfc4637a988f25eec8cfb41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca59cfbe7f3b494499cc8efe1d0e093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:47:00.661019 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-d4dacc4a-b01a-4472-be14-958068a7a111 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] 10.222.0.38 "GET /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2" status: 200 len: 1219 microversion: 2.1 time: 0.183308 Feb 17 04:47:00.661627 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 499/1002] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:47:00 2021] GET /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2 => generated 1219 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:47:01.681449 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-9e1c685e-2876-4d62-abbf-7f6a6e9f3f59 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:47:01.682226 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-9e1c685e-2876-4d62-abbf-7f6a6e9f3f59 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] [instance: e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:47:01.691725 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9e1c685e-2876-4d62-abbf-7f6a6e9f3f59 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:47:01.692241 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9e1c685e-2876-4d62-abbf-7f6a6e9f3f59 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:47:01.693088 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9e1c685e-2876-4d62-abbf-7f6a6e9f3f59 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:47:01.693590 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9e1c685e-2876-4d62-abbf-7f6a6e9f3f59 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:47:01.747853 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.wsgi [None req-9e1c685e-2876-4d62-abbf-7f6a6e9f3f59 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] HTTP exception thrown: Instance e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2 could not be found. Feb 17 04:47:01.748502 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-9e1c685e-2876-4d62-abbf-7f6a6e9f3f59 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Returning 404 to user: Instance e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2 could not be found. {{(pid=98081) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:47:01.749410 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-9e1c685e-2876-4d62-abbf-7f6a6e9f3f59 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] 10.222.0.38 "GET /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2" status: 404 len: 111 microversion: 2.1 time: 0.072553 Feb 17 04:47:01.750006 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 504/1003] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:47:01 2021] GET /compute/v2.1/servers/e4dc6454-9cdc-4cb2-85f4-a3e819cad6a2 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:47:01.758814 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-5334205e-4a26-47ce-92be-e040054349e4 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Calling method '.version_select at 0x7fc2ee9ee158>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:47:02.004836 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-5334205e-4a26-47ce-92be-e040054349e4 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] 10.222.0.38 "DELETE /compute/v2.1/os-security-groups/0b1b0d00-a62f-4b8a-bb68-8e9514059015" status: 202 len: 0 microversion: 2.1 time: 0.249778 Feb 17 04:47:02.005467 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 500/1004] 10.222.0.38 () {58 vars in 1262 bytes} [Wed Feb 17 04:47:01 2021] DELETE /compute/v2.1/os-security-groups/0b1b0d00-a62f-4b8a-bb68-8e9514059015 => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:47:02.014753 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-954c1667-b815-4ba0-86d5-79685c7642d9 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] Calling method '.version_select at 0x7fc2ea935ea0>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:47:02.032479 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-954c1667-b815-4ba0-86d5-79685c7642d9 tempest-TestShelveInstance-769237654 tempest-TestShelveInstance-769237654-project] 10.222.0.38 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1943374732" status: 202 len: 0 microversion: 2.1 time: 0.022344 Feb 17 04:47:02.033107 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 505/1005] 10.222.0.38 () {58 vars in 1244 bytes} [Wed Feb 17 04:47:02 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1943374732 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:47:25.921688 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-6b161d8e-c049-4a74-b2ad-ef9167baaa38 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:47:25.922234 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-6b161d8e-c049-4a74-b2ad-ef9167baaa38 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: 486ab1d3-d971-40c2-aca6-4ce6ef472355] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:47:25.929999 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6b161d8e-c049-4a74-b2ad-ef9167baaa38 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:47:25.930511 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6b161d8e-c049-4a74-b2ad-ef9167baaa38 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:47:25.931417 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6b161d8e-c049-4a74-b2ad-ef9167baaa38 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:47:25.931893 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6b161d8e-c049-4a74-b2ad-ef9167baaa38 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:47:26.013241 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-6b161d8e-c049-4a74-b2ad-ef9167baaa38 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: 486ab1d3-d971-40c2-aca6-4ce6ef472355] Going to try to terminate instance {{(pid=98080) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 04:47:26.145471 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-6b161d8e-c049-4a74-b2ad-ef9167baaa38 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "DELETE /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355" status: 204 len: 0 microversion: 2.1 time: 0.228209 Feb 17 04:47:26.149495 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 501/1006] 10.222.0.38 () {58 vars in 1229 bytes} [Wed Feb 17 04:47:25 2021] DELETE /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 17 04:47:26.157204 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-8bd6e66d-63fc-45e3-ac32-9cc60e4c46ea tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:47:26.158112 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-8bd6e66d-63fc-45e3-ac32-9cc60e4c46ea tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: 486ab1d3-d971-40c2-aca6-4ce6ef472355] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:47:26.167032 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8bd6e66d-63fc-45e3-ac32-9cc60e4c46ea tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:47:26.167802 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8bd6e66d-63fc-45e3-ac32-9cc60e4c46ea tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:47:26.171959 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8bd6e66d-63fc-45e3-ac32-9cc60e4c46ea tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:47:26.172647 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8bd6e66d-63fc-45e3-ac32-9cc60e4c46ea tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:47:26.397650 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-8bd6e66d-63fc-45e3-ac32-9cc60e4c46ea tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8b4cda0b044342ba470c32b33d0a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbfc8aedca448fab8273424e08aecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:47:26.406997 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-8bd6e66d-63fc-45e3-ac32-9cc60e4c46ea tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "GET /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355" status: 200 len: 1674 microversion: 2.1 time: 0.255947 Feb 17 04:47:26.407848 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 506/1007] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:47:26 2021] GET /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355 => generated 1674 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:47:27.429413 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-af52c94b-338d-4278-a653-fee4d8332704 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:47:27.430700 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-af52c94b-338d-4278-a653-fee4d8332704 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: 486ab1d3-d971-40c2-aca6-4ce6ef472355] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:47:27.442501 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-af52c94b-338d-4278-a653-fee4d8332704 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:47:27.443644 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-af52c94b-338d-4278-a653-fee4d8332704 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:47:27.446096 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-af52c94b-338d-4278-a653-fee4d8332704 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:47:27.450895 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-af52c94b-338d-4278-a653-fee4d8332704 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:47:27.718618 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-af52c94b-338d-4278-a653-fee4d8332704 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8b4cda0b044342ba470c32b33d0a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbfc8aedca448fab8273424e08aecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:47:27.729320 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-af52c94b-338d-4278-a653-fee4d8332704 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "GET /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355" status: 200 len: 1674 microversion: 2.1 time: 0.306041 Feb 17 04:47:27.730396 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 502/1008] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:47:27 2021] GET /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355 => generated 1674 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:47:28.759930 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-10d43c5d-3cde-4fa5-9f96-4aac2300a167 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:47:28.762239 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-10d43c5d-3cde-4fa5-9f96-4aac2300a167 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: 486ab1d3-d971-40c2-aca6-4ce6ef472355] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:47:28.776223 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-10d43c5d-3cde-4fa5-9f96-4aac2300a167 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:47:28.777123 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-10d43c5d-3cde-4fa5-9f96-4aac2300a167 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:47:28.779936 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-10d43c5d-3cde-4fa5-9f96-4aac2300a167 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:47:28.780707 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-10d43c5d-3cde-4fa5-9f96-4aac2300a167 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:47:29.341060 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [req-23d94d84-3bdb-424c-9362-f155c7a258c6 req-529c75f0-b7fa-483d-9ae8-353d270cd1d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "486ab1d3-d971-40c2-aca6-4ce6ef472355", "name": "network-vif-unplugged", "status": "completed", "tag": "49a28669-ba0f-4ebc-9e11-2ac8f664d4d4"}]} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:47:29.342818 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:47:29.342818 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:47:29.365240 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-23d94d84-3bdb-424c-9362-f155c7a258c6 req-529c75f0-b7fa-483d-9ae8-353d270cd1d5 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:47:29.365748 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-23d94d84-3bdb-424c-9362-f155c7a258c6 req-529c75f0-b7fa-483d-9ae8-353d270cd1d5 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:47:29.410227 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.compute.server_external_events [req-23d94d84-3bdb-424c-9362-f155c7a258c6 req-529c75f0-b7fa-483d-9ae8-353d270cd1d5 service nova] Creating event network-vif-unplugged:49a28669-ba0f-4ebc-9e11-2ac8f664d4d4 for instance 486ab1d3-d971-40c2-aca6-4ce6ef472355 on hv-cinder-76019 Feb 17 04:47:29.432325 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [req-23d94d84-3bdb-424c-9362-f155c7a258c6 req-529c75f0-b7fa-483d-9ae8-353d270cd1d5 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.396966 Feb 17 04:47:29.435123 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 503/1009] 10.222.0.38 () {64 vars in 1308 bytes} [Wed Feb 17 04:47:29 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:47:29.551170 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-10d43c5d-3cde-4fa5-9f96-4aac2300a167 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8b4cda0b044342ba470c32b33d0a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbfc8aedca448fab8273424e08aecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:47:29.566155 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-10d43c5d-3cde-4fa5-9f96-4aac2300a167 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "GET /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355" status: 200 len: 1674 microversion: 2.1 time: 0.818745 Feb 17 04:47:29.571687 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 507/1010] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:47:28 2021] GET /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355 => generated 1674 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:47:30.586424 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-9d0981be-0702-4207-8b0b-63918bb843eb tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:47:30.587241 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-9d0981be-0702-4207-8b0b-63918bb843eb tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: 486ab1d3-d971-40c2-aca6-4ce6ef472355] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:47:30.609379 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9d0981be-0702-4207-8b0b-63918bb843eb tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:47:30.610079 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9d0981be-0702-4207-8b0b-63918bb843eb tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:47:30.610792 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9d0981be-0702-4207-8b0b-63918bb843eb tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:47:30.611469 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9d0981be-0702-4207-8b0b-63918bb843eb tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:47:31.441830 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-9d0981be-0702-4207-8b0b-63918bb843eb tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8b4cda0b044342ba470c32b33d0a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbfc8aedca448fab8273424e08aecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:47:31.459230 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-9d0981be-0702-4207-8b0b-63918bb843eb tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "GET /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355" status: 200 len: 1674 microversion: 2.1 time: 0.877238 Feb 17 04:47:31.460119 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 504/1011] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:47:30 2021] GET /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355 => generated 1674 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:47:32.481531 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-e12a9285-fd66-4d56-b2c7-2536e97c296d tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:47:32.481531 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-e12a9285-fd66-4d56-b2c7-2536e97c296d tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: 486ab1d3-d971-40c2-aca6-4ce6ef472355] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:47:32.505371 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e12a9285-fd66-4d56-b2c7-2536e97c296d tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:47:32.506202 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e12a9285-fd66-4d56-b2c7-2536e97c296d tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:47:32.507250 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e12a9285-fd66-4d56-b2c7-2536e97c296d tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:47:32.507898 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e12a9285-fd66-4d56-b2c7-2536e97c296d tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:47:32.707099 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-e12a9285-fd66-4d56-b2c7-2536e97c296d tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8b4cda0b044342ba470c32b33d0a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbfc8aedca448fab8273424e08aecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:47:32.716863 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-e12a9285-fd66-4d56-b2c7-2536e97c296d tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "GET /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355" status: 200 len: 1607 microversion: 2.1 time: 0.240446 Feb 17 04:47:32.717467 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 508/1012] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:47:32 2021] GET /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355 => generated 1607 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:47:32.801269 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [req-d5e7d40e-7ade-4e8b-b3d8-9590ccd37b54 req-91157876-e696-4b5d-ae00-9d0bf963d04d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "486ab1d3-d971-40c2-aca6-4ce6ef472355", "name": "network-vif-deleted", "tag": "49a28669-ba0f-4ebc-9e11-2ac8f664d4d4"}]} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:47:32.803199 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:47:32.803199 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:47:32.813474 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-d5e7d40e-7ade-4e8b-b3d8-9590ccd37b54 req-91157876-e696-4b5d-ae00-9d0bf963d04d service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:47:32.814182 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-d5e7d40e-7ade-4e8b-b3d8-9590ccd37b54 req-91157876-e696-4b5d-ae00-9d0bf963d04d service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:47:32.838703 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.compute.server_external_events [req-d5e7d40e-7ade-4e8b-b3d8-9590ccd37b54 req-91157876-e696-4b5d-ae00-9d0bf963d04d service nova] Creating event network-vif-deleted:49a28669-ba0f-4ebc-9e11-2ac8f664d4d4 for instance 486ab1d3-d971-40c2-aca6-4ce6ef472355 on hv-cinder-76019 Feb 17 04:47:32.845864 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [req-d5e7d40e-7ade-4e8b-b3d8-9590ccd37b54 req-91157876-e696-4b5d-ae00-9d0bf963d04d service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048471 Feb 17 04:47:32.846958 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 505/1013] 10.222.0.38 () {64 vars in 1308 bytes} [Wed Feb 17 04:47:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:47:33.736212 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-df68da2a-4fa6-40db-8157-ae6a1796c1f7 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:47:33.737453 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-df68da2a-4fa6-40db-8157-ae6a1796c1f7 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: 486ab1d3-d971-40c2-aca6-4ce6ef472355] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:47:33.746305 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-df68da2a-4fa6-40db-8157-ae6a1796c1f7 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:47:33.747188 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-df68da2a-4fa6-40db-8157-ae6a1796c1f7 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:47:33.748278 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-df68da2a-4fa6-40db-8157-ae6a1796c1f7 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:47:33.748974 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-df68da2a-4fa6-40db-8157-ae6a1796c1f7 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:47:33.805621 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.wsgi [None req-df68da2a-4fa6-40db-8157-ae6a1796c1f7 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] HTTP exception thrown: Instance 486ab1d3-d971-40c2-aca6-4ce6ef472355 could not be found. Feb 17 04:47:33.806757 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-df68da2a-4fa6-40db-8157-ae6a1796c1f7 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Returning 404 to user: Instance 486ab1d3-d971-40c2-aca6-4ce6ef472355 could not be found. {{(pid=98081) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:47:33.808455 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-df68da2a-4fa6-40db-8157-ae6a1796c1f7 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "GET /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355" status: 404 len: 111 microversion: 2.1 time: 0.075853 Feb 17 04:47:33.809550 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 509/1014] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:47:33 2021] GET /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:47:33.819491 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-069e8904-ac78-4bd1-a16f-6ea586fed49e tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Calling method '.version_select at 0x7fc2ea995400>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:47:33.838612 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-069e8904-ac78-4bd1-a16f-6ea586fed49e tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1805510112" status: 202 len: 0 microversion: 2.1 time: 0.023649 Feb 17 04:47:33.855297 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 506/1015] 10.222.0.38 () {58 vars in 1211 bytes} [Wed Feb 17 04:47:33 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1805510112 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:47:35.305960 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-97e5bf5c-82d1-40df-8b48-ea3086a9f8a1 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Action: 'create', calling method: .version_select at 0x7fc2ee9e9048>, body: {"keypair": {"name": "tempest-keypair-1174513517"}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:47:35.331985 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.quota [None req-97e5bf5c-82d1-40df-8b48-ea3086a9f8a1 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Getting quotas for project 7dbfc8aedca448fab8273424e08aecf0. Resources: {'key_pairs'} {{(pid=98081) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:47:35.336874 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.quota [None req-97e5bf5c-82d1-40df-8b48-ea3086a9f8a1 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Getting quotas for user 1d8b4cda0b044342ba470c32b33d0a14 and project 7dbfc8aedca448fab8273424e08aecf0. Resources: {'key_pairs'} {{(pid=98081) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:47:35.633399 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-6657e221-e84e-40d8-89e2-83b74c073b37 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Action: 'create', calling method: .version_select at 0x7fc2e96c9488>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2057480649"}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:47:35.635110 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.quota [None req-97e5bf5c-82d1-40df-8b48-ea3086a9f8a1 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Getting quotas for project 7dbfc8aedca448fab8273424e08aecf0. Resources: {'key_pairs'} {{(pid=98081) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:47:35.640221 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.quota [None req-97e5bf5c-82d1-40df-8b48-ea3086a9f8a1 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Getting quotas for user 1d8b4cda0b044342ba470c32b33d0a14 and project 7dbfc8aedca448fab8273424e08aecf0. Resources: {'key_pairs'} {{(pid=98081) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:47:35.654905 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-97e5bf5c-82d1-40df-8b48-ea3086a9f8a1 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.353438 Feb 17 04:47:35.655788 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 510/1016] 10.222.0.38 () {60 vars in 1148 bytes} [Wed Feb 17 04:47:35 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:47:35.658603 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.quota [None req-6657e221-e84e-40d8-89e2-83b74c073b37 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Getting quotas for project 01cb524e7a8d4981b00474e1d9ed2062. Resources: {'key_pairs'} {{(pid=98080) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:47:35.662997 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.quota [None req-6657e221-e84e-40d8-89e2-83b74c073b37 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Getting quotas for user 75f25433642c4ea1996f8b1da7bf21d4 and project 01cb524e7a8d4981b00474e1d9ed2062. Resources: {'key_pairs'} {{(pid=98080) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:47:35.961160 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.quota [None req-6657e221-e84e-40d8-89e2-83b74c073b37 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Getting quotas for project 01cb524e7a8d4981b00474e1d9ed2062. Resources: {'key_pairs'} {{(pid=98080) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:47:35.966630 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.quota [None req-6657e221-e84e-40d8-89e2-83b74c073b37 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Getting quotas for user 75f25433642c4ea1996f8b1da7bf21d4 and project 01cb524e7a8d4981b00474e1d9ed2062. Resources: {'key_pairs'} {{(pid=98080) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:47:35.982048 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-6657e221-e84e-40d8-89e2-83b74c073b37 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] 10.222.0.38 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 0.472821 Feb 17 04:47:35.982713 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 507/1017] 10.222.0.38 () {60 vars in 1148 bytes} [Wed Feb 17 04:47:35 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:47:35.993358 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-d3340a1d-160f-4c59-909c-cd4c86f849b2 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Action: 'create', calling method: .version_select at 0x7fc2ea935ea0>, body: {"security_group": {"name": "tempest-TestVolumeBootPattern-1134504179", "description": "tempest-TestVolumeBootPattern-1134504179 description"}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:47:36.213537 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-d3340a1d-160f-4c59-909c-cd4c86f849b2 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] 10.222.0.38 "POST /compute/v2.1/os-security-groups" status: 200 len: 251 microversion: 2.1 time: 0.224134 Feb 17 04:47:36.214724 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 511/1018] 10.222.0.38 () {60 vars in 1170 bytes} [Wed Feb 17 04:47:35 2021] POST /compute/v2.1/os-security-groups => generated 251 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:47:36.226827 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-1d08b186-6e74-4725-ab3c-381e10e53dbf tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Action: 'create', calling method: .version_select at 0x7fc2e96c9ea0>, body: {"security_group_rule": {"parent_group_id": "0d6c5764-0a4b-4bdf-9c66-dbe465e68a73", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "0.0.0.0/0"}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:47:36.444236 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-1d08b186-6e74-4725-ab3c-381e10e53dbf tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] 10.222.0.38 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.221348 Feb 17 04:47:36.444900 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 508/1019] 10.222.0.38 () {60 vars in 1185 bytes} [Wed Feb 17 04:47:36 2021] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:47:36.456949 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-d41d5cc2-8ea4-4d16-aae5-24fb2bd4bfd7 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Action: 'create', calling method: .version_select at 0x7fc2eb406b70>, body: {"security_group_rule": {"parent_group_id": "0d6c5764-0a4b-4bdf-9c66-dbe465e68a73", "ip_protocol": "icmp", "from_port": -1, "to_port": -1, "cidr": "0.0.0.0/0"}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:47:36.677202 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-d41d5cc2-8ea4-4d16-aae5-24fb2bd4bfd7 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] 10.222.0.38 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.224095 Feb 17 04:47:36.677866 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 512/1020] 10.222.0.38 () {60 vars in 1185 bytes} [Wed Feb 17 04:47:36 2021] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:47:38.042661 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-c1e9e746-c828-4df5-af29-f44e66db94f0 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1448577747", "imageRef": "2d6991a7-a1f0-444b-8fd5-d05558b5f9a4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "31fedee6-4f2b-4144-ad68-a6683410778d"}], "security_groups": [{"name": "tempest-securitygroup--488743855"}], "key_name": "tempest-keypair-1174513517", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:47:38.163032 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.network.neutron [None req-c1e9e746-c828-4df5-af29-f44e66db94f0 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] validate_networks() for [('31fedee6-4f2b-4144-ad68-a6683410778d', None, None, None)] {{(pid=98080) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 04:47:38.930430 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-c1e9e746-c828-4df5-af29-f44e66db94f0 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Flavor limits 0:0:0 {{(pid=98080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 04:47:38.930973 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-c1e9e746-c828-4df5-af29-f44e66db94f0 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Image limits 0:0:0 {{(pid=98080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 04:47:38.931518 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-c1e9e746-c828-4df5-af29-f44e66db94f0 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Flavor pref 0:0:0 {{(pid=98080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 04:47:38.932066 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-c1e9e746-c828-4df5-af29-f44e66db94f0 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Image pref 0:0:0 {{(pid=98080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 04:47:38.933228 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-c1e9e746-c828-4df5-af29-f44e66db94f0 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 04:47:38.943447 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c1e9e746-c828-4df5-af29-f44e66db94f0 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:47:38.943985 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c1e9e746-c828-4df5-af29-f44e66db94f0 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:47:38.944874 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c1e9e746-c828-4df5-af29-f44e66db94f0 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:47:38.945373 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c1e9e746-c828-4df5-af29-f44e66db94f0 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:47:38.964901 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.quota [None req-c1e9e746-c828-4df5-af29-f44e66db94f0 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Getting quotas for project 7dbfc8aedca448fab8273424e08aecf0. Resources: {'instances', 'cores', 'ram'} {{(pid=98080) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:47:38.970271 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.quota [None req-c1e9e746-c828-4df5-af29-f44e66db94f0 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Getting quotas for user 1d8b4cda0b044342ba470c32b33d0a14 and project 7dbfc8aedca448fab8273424e08aecf0. Resources: {'instances', 'cores', 'ram'} {{(pid=98080) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:47:38.982708 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-c1e9e746-c828-4df5-af29-f44e66db94f0 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Going to run 1 instances... {{(pid=98080) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 04:47:38.985415 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-c1e9e746-c828-4df5-af29-f44e66db94f0 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: d62edd91-1355-4cb6-875b-86f12f404a69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d6991a7-a1f0-444b-8fd5-d05558b5f9a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98080) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 04:47:39.040645 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-c1e9e746-c828-4df5-af29-f44e66db94f0 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.002962 Feb 17 04:47:39.041553 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 509/1021] 10.222.0.38 () {60 vars in 1137 bytes} [Wed Feb 17 04:47:38 2021] POST /compute/v2.1/servers => generated 401 bytes in 1004 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 17 04:47:39.053054 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-071748f8-d114-4605-af87-ca3cca49e7ac tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:47:39.053696 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-071748f8-d114-4605-af87-ca3cca49e7ac tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: d62edd91-1355-4cb6-875b-86f12f404a69] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:47:39.140674 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-071748f8-d114-4605-af87-ca3cca49e7ac tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8b4cda0b044342ba470c32b33d0a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbfc8aedca448fab8273424e08aecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:47:39.149697 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-071748f8-d114-4605-af87-ca3cca49e7ac tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "GET /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69" status: 200 len: 1238 microversion: 2.1 time: 0.100502 Feb 17 04:47:39.150322 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 513/1022] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:47:39 2021] GET /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69 => generated 1238 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:47:40.169560 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-eb0fc901-a454-4262-b9da-e8d49822b82a tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:47:40.170912 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-eb0fc901-a454-4262-b9da-e8d49822b82a tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: d62edd91-1355-4cb6-875b-86f12f404a69] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:47:40.257532 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-eb0fc901-a454-4262-b9da-e8d49822b82a tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8b4cda0b044342ba470c32b33d0a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbfc8aedca448fab8273424e08aecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:47:40.271191 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-eb0fc901-a454-4262-b9da-e8d49822b82a tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "GET /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69" status: 200 len: 1238 microversion: 2.1 time: 0.106160 Feb 17 04:47:40.271823 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 510/1023] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:47:40 2021] GET /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69 => generated 1238 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:47:41.289595 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-cc51dc01-48ce-4e3b-a84d-8a036ce5a5c1 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:47:41.290255 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-cc51dc01-48ce-4e3b-a84d-8a036ce5a5c1 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: d62edd91-1355-4cb6-875b-86f12f404a69] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:47:41.299463 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-cc51dc01-48ce-4e3b-a84d-8a036ce5a5c1 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:47:41.299980 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-cc51dc01-48ce-4e3b-a84d-8a036ce5a5c1 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:47:41.300854 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-cc51dc01-48ce-4e3b-a84d-8a036ce5a5c1 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:47:41.301358 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-cc51dc01-48ce-4e3b-a84d-8a036ce5a5c1 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:47:41.504016 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-cc51dc01-48ce-4e3b-a84d-8a036ce5a5c1 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8b4cda0b044342ba470c32b33d0a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbfc8aedca448fab8273424e08aecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:47:41.514859 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-cc51dc01-48ce-4e3b-a84d-8a036ce5a5c1 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "GET /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69" status: 200 len: 1298 microversion: 2.1 time: 0.229049 Feb 17 04:47:41.515717 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 514/1024] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:47:41 2021] GET /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69 => generated 1298 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:47:42.533675 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-2ea717dd-abab-4a7e-bc0b-bf327a884e22 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:47:42.534475 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-2ea717dd-abab-4a7e-bc0b-bf327a884e22 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: d62edd91-1355-4cb6-875b-86f12f404a69] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:47:42.546558 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2ea717dd-abab-4a7e-bc0b-bf327a884e22 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:47:42.551598 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2ea717dd-abab-4a7e-bc0b-bf327a884e22 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:47:42.552534 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2ea717dd-abab-4a7e-bc0b-bf327a884e22 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:47:42.553042 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2ea717dd-abab-4a7e-bc0b-bf327a884e22 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:47:42.893752 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-2ea717dd-abab-4a7e-bc0b-bf327a884e22 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8b4cda0b044342ba470c32b33d0a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbfc8aedca448fab8273424e08aecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:47:42.914093 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-2ea717dd-abab-4a7e-bc0b-bf327a884e22 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "GET /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69" status: 200 len: 1363 microversion: 2.1 time: 0.384279 Feb 17 04:47:42.914846 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 511/1025] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:47:42 2021] GET /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69 => generated 1363 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:47:43.932982 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-913df9bb-60b2-4c07-84a6-5ba1480aada5 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:47:43.933941 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-913df9bb-60b2-4c07-84a6-5ba1480aada5 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: d62edd91-1355-4cb6-875b-86f12f404a69] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:47:43.963287 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-913df9bb-60b2-4c07-84a6-5ba1480aada5 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:47:43.964432 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-913df9bb-60b2-4c07-84a6-5ba1480aada5 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:47:43.965497 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-913df9bb-60b2-4c07-84a6-5ba1480aada5 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:47:43.966349 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-913df9bb-60b2-4c07-84a6-5ba1480aada5 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:47:44.497875 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-913df9bb-60b2-4c07-84a6-5ba1480aada5 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8b4cda0b044342ba470c32b33d0a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbfc8aedca448fab8273424e08aecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:47:44.507146 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-913df9bb-60b2-4c07-84a6-5ba1480aada5 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "GET /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69" status: 200 len: 1363 microversion: 2.1 time: 0.578158 Feb 17 04:47:44.507753 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 515/1026] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:47:43 2021] GET /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69 => generated 1363 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:47:44.622197 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [req-b6bbffe9-b9c7-43a3-9909-466b9c2ee0dc req-f10c3257-ba86-4c95-8138-ed7ffc376a0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d62edd91-1355-4cb6-875b-86f12f404a69", "tag": "2ded8dbd-6518-4ac7-bad2-d6eb541e39c4"}]} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:47:44.626999 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:47:44.626999 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:47:44.637030 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-b6bbffe9-b9c7-43a3-9909-466b9c2ee0dc req-f10c3257-ba86-4c95-8138-ed7ffc376a0a service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:47:44.637673 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-b6bbffe9-b9c7-43a3-9909-466b9c2ee0dc req-f10c3257-ba86-4c95-8138-ed7ffc376a0a service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:47:44.656998 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.compute.server_external_events [req-b6bbffe9-b9c7-43a3-9909-466b9c2ee0dc req-f10c3257-ba86-4c95-8138-ed7ffc376a0a service nova] Creating event network-changed:2ded8dbd-6518-4ac7-bad2-d6eb541e39c4 for instance d62edd91-1355-4cb6-875b-86f12f404a69 on hv-cinder-76019 Feb 17 04:47:44.662812 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [req-b6bbffe9-b9c7-43a3-9909-466b9c2ee0dc req-f10c3257-ba86-4c95-8138-ed7ffc376a0a service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044864 Feb 17 04:47:44.663642 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 512/1027] 10.222.0.38 () {64 vars in 1308 bytes} [Wed Feb 17 04:47:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:47:45.525745 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-46b2859f-afd6-4e35-a0d8-52d726337b25 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:47:45.527291 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-46b2859f-afd6-4e35-a0d8-52d726337b25 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: d62edd91-1355-4cb6-875b-86f12f404a69] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:47:45.535270 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-46b2859f-afd6-4e35-a0d8-52d726337b25 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:47:45.535873 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-46b2859f-afd6-4e35-a0d8-52d726337b25 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:47:45.536826 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-46b2859f-afd6-4e35-a0d8-52d726337b25 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:47:45.537509 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-46b2859f-afd6-4e35-a0d8-52d726337b25 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:47:45.892821 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-46b2859f-afd6-4e35-a0d8-52d726337b25 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8b4cda0b044342ba470c32b33d0a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbfc8aedca448fab8273424e08aecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:47:45.902192 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-46b2859f-afd6-4e35-a0d8-52d726337b25 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "GET /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69" status: 200 len: 1363 microversion: 2.1 time: 0.380571 Feb 17 04:47:45.902823 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 516/1028] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:47:45 2021] GET /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69 => generated 1363 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:47:46.921447 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-7281035d-8f9d-4163-89f7-8a1ac50fbf28 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:47:46.922204 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-7281035d-8f9d-4163-89f7-8a1ac50fbf28 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: d62edd91-1355-4cb6-875b-86f12f404a69] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:47:46.930549 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7281035d-8f9d-4163-89f7-8a1ac50fbf28 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:47:46.931114 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7281035d-8f9d-4163-89f7-8a1ac50fbf28 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:47:46.931961 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7281035d-8f9d-4163-89f7-8a1ac50fbf28 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:47:46.932496 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7281035d-8f9d-4163-89f7-8a1ac50fbf28 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:47:47.156378 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-7281035d-8f9d-4163-89f7-8a1ac50fbf28 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8b4cda0b044342ba470c32b33d0a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbfc8aedca448fab8273424e08aecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:47:47.168740 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-7281035d-8f9d-4163-89f7-8a1ac50fbf28 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "GET /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69" status: 200 len: 1363 microversion: 2.1 time: 0.251997 Feb 17 04:47:47.169365 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 513/1029] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:47:46 2021] GET /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69 => generated 1363 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:47:47.401850 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [req-76111b63-3f93-4f45-928f-f40337ee7265 req-2b5738fa-bceb-4bcf-a5d4-40c94485b069 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d62edd91-1355-4cb6-875b-86f12f404a69", "name": "network-vif-plugged", "status": "completed", "tag": "2ded8dbd-6518-4ac7-bad2-d6eb541e39c4"}]} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:47:47.404233 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:47:47.404233 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:47:47.413911 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-76111b63-3f93-4f45-928f-f40337ee7265 req-2b5738fa-bceb-4bcf-a5d4-40c94485b069 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:47:47.414412 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-76111b63-3f93-4f45-928f-f40337ee7265 req-2b5738fa-bceb-4bcf-a5d4-40c94485b069 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:47:47.433965 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.compute.server_external_events [req-76111b63-3f93-4f45-928f-f40337ee7265 req-2b5738fa-bceb-4bcf-a5d4-40c94485b069 service nova] Creating event network-vif-plugged:2ded8dbd-6518-4ac7-bad2-d6eb541e39c4 for instance d62edd91-1355-4cb6-875b-86f12f404a69 on hv-cinder-76019 Feb 17 04:47:47.439454 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [req-76111b63-3f93-4f45-928f-f40337ee7265 req-2b5738fa-bceb-4bcf-a5d4-40c94485b069 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041735 Feb 17 04:47:47.440403 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 517/1030] 10.222.0.38 () {64 vars in 1308 bytes} [Wed Feb 17 04:47:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:47:48.187543 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-859ed4e0-d253-401d-ae1c-0d4e9cd4affa tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:47:48.188214 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-859ed4e0-d253-401d-ae1c-0d4e9cd4affa tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: d62edd91-1355-4cb6-875b-86f12f404a69] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:47:48.196070 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-859ed4e0-d253-401d-ae1c-0d4e9cd4affa tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:47:48.196584 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-859ed4e0-d253-401d-ae1c-0d4e9cd4affa tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:47:48.197421 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-859ed4e0-d253-401d-ae1c-0d4e9cd4affa tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:47:48.197920 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-859ed4e0-d253-401d-ae1c-0d4e9cd4affa tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:47:48.414418 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-859ed4e0-d253-401d-ae1c-0d4e9cd4affa tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8b4cda0b044342ba470c32b33d0a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbfc8aedca448fab8273424e08aecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:47:48.423723 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-859ed4e0-d253-401d-ae1c-0d4e9cd4affa tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "GET /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69" status: 200 len: 1363 microversion: 2.1 time: 0.241013 Feb 17 04:47:48.424330 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 514/1031] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:47:48 2021] GET /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69 => generated 1363 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:47:49.442416 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-ccbebd88-22d6-4714-978a-a71f40187a60 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:47:49.443202 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-ccbebd88-22d6-4714-978a-a71f40187a60 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: d62edd91-1355-4cb6-875b-86f12f404a69] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:47:49.451439 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ccbebd88-22d6-4714-978a-a71f40187a60 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:47:49.451938 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ccbebd88-22d6-4714-978a-a71f40187a60 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:47:49.452769 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ccbebd88-22d6-4714-978a-a71f40187a60 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:47:49.453260 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ccbebd88-22d6-4714-978a-a71f40187a60 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:47:49.673155 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-ccbebd88-22d6-4714-978a-a71f40187a60 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8b4cda0b044342ba470c32b33d0a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbfc8aedca448fab8273424e08aecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:47:49.682209 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-ccbebd88-22d6-4714-978a-a71f40187a60 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "GET /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69" status: 200 len: 1549 microversion: 2.1 time: 0.244221 Feb 17 04:47:49.682840 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 518/1032] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:47:49 2021] GET /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69 => generated 1549 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:47:49.700594 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-04080fc1-d956-4cfe-9c2d-b96f3fc2075e tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:47:49.701121 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-04080fc1-d956-4cfe-9c2d-b96f3fc2075e tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: d62edd91-1355-4cb6-875b-86f12f404a69] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:47:49.708945 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-04080fc1-d956-4cfe-9c2d-b96f3fc2075e tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:47:49.709462 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-04080fc1-d956-4cfe-9c2d-b96f3fc2075e tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:47:49.710302 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-04080fc1-d956-4cfe-9c2d-b96f3fc2075e tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:47:49.710828 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-04080fc1-d956-4cfe-9c2d-b96f3fc2075e tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:47:49.868391 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-04080fc1-d956-4cfe-9c2d-b96f3fc2075e tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "GET /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.172229 Feb 17 04:47:49.869041 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 515/1033] 10.222.0.38 () {58 vars in 1265 bytes} [Wed Feb 17 04:47:49 2021] GET /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69/os-interface => generated 284 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:47:51.801179 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-cee7bb5d-0a4d-4b58-bbda-40f6ee6eb5cf tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:47:51.802242 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-cee7bb5d-0a4d-4b58-bbda-40f6ee6eb5cf tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: d62edd91-1355-4cb6-875b-86f12f404a69] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:47:51.818940 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-cee7bb5d-0a4d-4b58-bbda-40f6ee6eb5cf tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:47:51.819455 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-cee7bb5d-0a4d-4b58-bbda-40f6ee6eb5cf tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:47:51.820283 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-cee7bb5d-0a4d-4b58-bbda-40f6ee6eb5cf tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:47:51.820964 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-cee7bb5d-0a4d-4b58-bbda-40f6ee6eb5cf tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:47:51.871396 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [req-ce0823fb-2971-445e-971d-8c4a2dfceb17 req-c59031ad-b714-4cc0-8d51-baa92367ed76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d62edd91-1355-4cb6-875b-86f12f404a69", "tag": "2ded8dbd-6518-4ac7-bad2-d6eb541e39c4"}]} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:47:51.873278 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:47:51.873278 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:47:51.882867 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-ce0823fb-2971-445e-971d-8c4a2dfceb17 req-c59031ad-b714-4cc0-8d51-baa92367ed76 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:47:51.883380 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-ce0823fb-2971-445e-971d-8c4a2dfceb17 req-c59031ad-b714-4cc0-8d51-baa92367ed76 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:47:51.903174 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.compute.server_external_events [req-ce0823fb-2971-445e-971d-8c4a2dfceb17 req-c59031ad-b714-4cc0-8d51-baa92367ed76 service nova] Creating event network-changed:2ded8dbd-6518-4ac7-bad2-d6eb541e39c4 for instance d62edd91-1355-4cb6-875b-86f12f404a69 on hv-cinder-76019 Feb 17 04:47:51.908549 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [req-ce0823fb-2971-445e-971d-8c4a2dfceb17 req-c59031ad-b714-4cc0-8d51-baa92367ed76 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108812 Feb 17 04:47:51.909224 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 516/1034] 10.222.0.38 () {64 vars in 1308 bytes} [Wed Feb 17 04:47:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:47:51.923029 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-cee7bb5d-0a4d-4b58-bbda-40f6ee6eb5cf tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "POST /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69/action" status: 200 len: 14 microversion: 2.1 time: 0.125686 Feb 17 04:47:51.923763 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 519/1035] 10.222.0.38 () {60 vars in 1268 bytes} [Wed Feb 17 04:47:51 2021] POST /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69/action => generated 14 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:47:52.936641 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-812f1273-b488-4418-997e-edcd39e9070e tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:47:52.937913 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-812f1273-b488-4418-997e-edcd39e9070e tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: d62edd91-1355-4cb6-875b-86f12f404a69] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:47:52.946385 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-812f1273-b488-4418-997e-edcd39e9070e tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:47:52.946661 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-812f1273-b488-4418-997e-edcd39e9070e tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:47:52.947750 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-812f1273-b488-4418-997e-edcd39e9070e tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:47:52.948082 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-812f1273-b488-4418-997e-edcd39e9070e tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:47:53.050606 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-812f1273-b488-4418-997e-edcd39e9070e tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "POST /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69/action" status: 200 len: 14 microversion: 2.1 time: 0.119078 Feb 17 04:47:53.052072 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 517/1036] 10.222.0.38 () {60 vars in 1268 bytes} [Wed Feb 17 04:47:52 2021] POST /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69/action => generated 14 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:47:53.053831 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-3d0d1a59-c210-456d-94b1-8c33a48ab579 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1483095642", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2057480649", "security_groups": [{"name": "tempest-TestVolumeBootPattern-1134504179"}], "block_device_mapping_v2": [{"uuid": "57e4bdb6-5172-45e1-95c2-4b11ef95e6b3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a877ef56-9526-4e88-a555-4c4a4c974334"}]}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:47:53.248600 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.network.neutron [None req-3d0d1a59-c210-456d-94b1-8c33a48ab579 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] validate_networks() for [('a877ef56-9526-4e88-a555-4c4a4c974334', None, None, None)] {{(pid=98081) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 04:47:54.063554 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-4648cfb4-6d83-4cec-ac2d-792a0d99e3a1 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:47:54.064614 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-4648cfb4-6d83-4cec-ac2d-792a0d99e3a1 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: d62edd91-1355-4cb6-875b-86f12f404a69] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:47:54.073146 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4648cfb4-6d83-4cec-ac2d-792a0d99e3a1 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:47:54.073656 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4648cfb4-6d83-4cec-ac2d-792a0d99e3a1 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:47:54.074604 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4648cfb4-6d83-4cec-ac2d-792a0d99e3a1 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:47:54.075015 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4648cfb4-6d83-4cec-ac2d-792a0d99e3a1 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:47:54.127932 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-3d0d1a59-c210-456d-94b1-8c33a48ab579 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Flavor limits 0:0:0 {{(pid=98081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 04:47:54.128585 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-3d0d1a59-c210-456d-94b1-8c33a48ab579 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Image limits 0:0:0 {{(pid=98081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 04:47:54.129163 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-3d0d1a59-c210-456d-94b1-8c33a48ab579 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Flavor pref 0:0:0 {{(pid=98081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 04:47:54.129633 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-3d0d1a59-c210-456d-94b1-8c33a48ab579 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Image pref 0:0:0 {{(pid=98081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 04:47:54.130106 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-3d0d1a59-c210-456d-94b1-8c33a48ab579 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 04:47:54.139666 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-3d0d1a59-c210-456d-94b1-8c33a48ab579 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:47:54.140181 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-3d0d1a59-c210-456d-94b1-8c33a48ab579 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:47:54.141160 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-3d0d1a59-c210-456d-94b1-8c33a48ab579 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:47:54.141667 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-3d0d1a59-c210-456d-94b1-8c33a48ab579 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:47:54.161184 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.quota [None req-3d0d1a59-c210-456d-94b1-8c33a48ab579 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Getting quotas for project 01cb524e7a8d4981b00474e1d9ed2062. Resources: {'instances', 'cores', 'ram'} {{(pid=98081) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:47:54.165533 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.quota [None req-3d0d1a59-c210-456d-94b1-8c33a48ab579 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Getting quotas for user 75f25433642c4ea1996f8b1da7bf21d4 and project 01cb524e7a8d4981b00474e1d9ed2062. Resources: {'instances', 'cores', 'ram'} {{(pid=98081) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:47:54.172815 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-4648cfb4-6d83-4cec-ac2d-792a0d99e3a1 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "POST /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69/action" status: 200 len: 14 microversion: 2.1 time: 0.113933 Feb 17 04:47:54.173649 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 518/1037] 10.222.0.38 () {60 vars in 1268 bytes} [Wed Feb 17 04:47:54 2021] POST /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69/action => generated 14 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Feb 17 04:47:54.271508 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-3d0d1a59-c210-456d-94b1-8c33a48ab579 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Going to run 1 instances... {{(pid=98081) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 04:47:54.274093 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-3d0d1a59-c210-456d-94b1-8c33a48ab579 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] [instance: ed61fd7e-829e-4928-8dc9-4597d4d49aec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='57e4bdb6-5172-45e1-95c2-4b11ef95e6b3',volume_size=None,volume_type=None)] {{(pid=98081) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 04:47:54.447837 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3d0d1a59-c210-456d-94b1-8c33a48ab579 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] [cc3d8000-5bf0-4e2d-a672-26c95c600476] AMQP server on 10.222.0.38:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Feb 17 04:47:55.185549 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-71607cae-7783-442f-a203-eeb1499180e8 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:47:55.186691 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-71607cae-7783-442f-a203-eeb1499180e8 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: d62edd91-1355-4cb6-875b-86f12f404a69] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:47:55.195150 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-71607cae-7783-442f-a203-eeb1499180e8 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:47:55.195659 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-71607cae-7783-442f-a203-eeb1499180e8 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:47:55.196488 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-71607cae-7783-442f-a203-eeb1499180e8 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:47:55.196981 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-71607cae-7783-442f-a203-eeb1499180e8 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:47:55.293561 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-71607cae-7783-442f-a203-eeb1499180e8 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "POST /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69/action" status: 200 len: 14 microversion: 2.1 time: 0.112268 Feb 17 04:47:55.294173 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 519/1038] 10.222.0.38 () {60 vars in 1268 bytes} [Wed Feb 17 04:47:55 2021] POST /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69/action => generated 14 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Feb 17 04:47:55.465096 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO oslo.messaging._drivers.impl_rabbit [None req-3d0d1a59-c210-456d-94b1-8c33a48ab579 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] [cc3d8000-5bf0-4e2d-a672-26c95c600476] Reconnected to AMQP server on 10.222.0.38:5672 via [amqp] client with port 57412. Feb 17 04:47:55.469755 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-3d0d1a59-c210-456d-94b1-8c33a48ab579 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] 10.222.0.38 "POST /compute/v2.1/servers" status: 202 len: 413 microversion: 2.1 time: 2.420806 Feb 17 04:47:55.470454 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 520/1039] 10.222.0.38 () {60 vars in 1137 bytes} [Wed Feb 17 04:47:53 2021] POST /compute/v2.1/servers => generated 413 bytes in 2422 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 17 04:47:55.482035 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-d17c77a4-44fd-4575-a509-07b609af2033 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:47:55.482830 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-d17c77a4-44fd-4575-a509-07b609af2033 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] [instance: ed61fd7e-829e-4928-8dc9-4597d4d49aec] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:47:55.563227 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-d17c77a4-44fd-4575-a509-07b609af2033 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f25433642c4ea1996f8b1da7bf21d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cb524e7a8d4981b00474e1d9ed2062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:47:55.571709 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-d17c77a4-44fd-4575-a509-07b609af2033 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] 10.222.0.38 "GET /compute/v2.1/servers/ed61fd7e-829e-4928-8dc9-4597d4d49aec" status: 200 len: 1095 microversion: 2.1 time: 0.094182 Feb 17 04:47:55.572313 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 520/1040] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:47:55 2021] GET /compute/v2.1/servers/ed61fd7e-829e-4928-8dc9-4597d4d49aec => generated 1095 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:47:56.305697 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-30bee11f-0d69-4816-a7a3-e639161c432f tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:47:56.306877 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-30bee11f-0d69-4816-a7a3-e639161c432f tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: d62edd91-1355-4cb6-875b-86f12f404a69] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:47:56.315536 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-30bee11f-0d69-4816-a7a3-e639161c432f tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:47:56.316053 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-30bee11f-0d69-4816-a7a3-e639161c432f tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:47:56.316904 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-30bee11f-0d69-4816-a7a3-e639161c432f tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:47:56.317416 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-30bee11f-0d69-4816-a7a3-e639161c432f tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:47:56.412803 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-30bee11f-0d69-4816-a7a3-e639161c432f tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "POST /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69/action" status: 200 len: 14 microversion: 2.1 time: 0.111458 Feb 17 04:47:56.413496 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 521/1041] 10.222.0.38 () {60 vars in 1268 bytes} [Wed Feb 17 04:47:56 2021] POST /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69/action => generated 14 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:47:56.592040 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-489b52bf-5f77-49db-a4eb-1875811b547d tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:47:56.592713 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-489b52bf-5f77-49db-a4eb-1875811b547d tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] [instance: ed61fd7e-829e-4928-8dc9-4597d4d49aec] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:47:56.602292 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-489b52bf-5f77-49db-a4eb-1875811b547d tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:47:56.602845 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-489b52bf-5f77-49db-a4eb-1875811b547d tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:47:56.603690 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-489b52bf-5f77-49db-a4eb-1875811b547d tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:47:56.604163 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-489b52bf-5f77-49db-a4eb-1875811b547d tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:47:56.743346 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-489b52bf-5f77-49db-a4eb-1875811b547d tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f25433642c4ea1996f8b1da7bf21d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cb524e7a8d4981b00474e1d9ed2062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:47:56.752751 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-489b52bf-5f77-49db-a4eb-1875811b547d tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] 10.222.0.38 "GET /compute/v2.1/servers/ed61fd7e-829e-4928-8dc9-4597d4d49aec" status: 200 len: 1211 microversion: 2.1 time: 0.165764 Feb 17 04:47:56.753368 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 521/1042] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:47:56 2021] GET /compute/v2.1/servers/ed61fd7e-829e-4928-8dc9-4597d4d49aec => generated 1211 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:47:57.425846 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-ab02339b-8c20-4095-9df8-60933adadd82 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:47:57.427011 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-ab02339b-8c20-4095-9df8-60933adadd82 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: d62edd91-1355-4cb6-875b-86f12f404a69] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:47:57.436558 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ab02339b-8c20-4095-9df8-60933adadd82 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:47:57.437070 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ab02339b-8c20-4095-9df8-60933adadd82 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:47:57.437912 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ab02339b-8c20-4095-9df8-60933adadd82 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:47:57.438408 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ab02339b-8c20-4095-9df8-60933adadd82 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:47:57.533073 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-ab02339b-8c20-4095-9df8-60933adadd82 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "POST /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69/action" status: 200 len: 14 microversion: 2.1 time: 0.111563 Feb 17 04:47:57.533776 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 522/1043] 10.222.0.38 () {60 vars in 1268 bytes} [Wed Feb 17 04:47:57 2021] POST /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69/action => generated 14 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:47:57.771876 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-6dde6686-ebc9-4ff4-af4f-da95ffa21ae2 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:47:57.772589 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-6dde6686-ebc9-4ff4-af4f-da95ffa21ae2 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] [instance: ed61fd7e-829e-4928-8dc9-4597d4d49aec] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:47:57.783506 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6dde6686-ebc9-4ff4-af4f-da95ffa21ae2 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:47:57.784019 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6dde6686-ebc9-4ff4-af4f-da95ffa21ae2 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:47:57.784883 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6dde6686-ebc9-4ff4-af4f-da95ffa21ae2 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:47:57.785379 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6dde6686-ebc9-4ff4-af4f-da95ffa21ae2 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:47:58.258482 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-6dde6686-ebc9-4ff4-af4f-da95ffa21ae2 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f25433642c4ea1996f8b1da7bf21d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cb524e7a8d4981b00474e1d9ed2062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:47:58.267640 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-6dde6686-ebc9-4ff4-af4f-da95ffa21ae2 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] 10.222.0.38 "GET /compute/v2.1/servers/ed61fd7e-829e-4928-8dc9-4597d4d49aec" status: 200 len: 1274 microversion: 2.1 time: 0.499925 Feb 17 04:47:58.268236 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 522/1044] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:47:57 2021] GET /compute/v2.1/servers/ed61fd7e-829e-4928-8dc9-4597d4d49aec => generated 1274 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:47:58.545703 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-85490356-64aa-48e4-8752-bf2b0ea7865f tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:47:58.546907 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-85490356-64aa-48e4-8752-bf2b0ea7865f tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: d62edd91-1355-4cb6-875b-86f12f404a69] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:47:58.555884 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-85490356-64aa-48e4-8752-bf2b0ea7865f tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:47:58.556407 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-85490356-64aa-48e4-8752-bf2b0ea7865f tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:47:58.557268 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-85490356-64aa-48e4-8752-bf2b0ea7865f tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:47:58.557773 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-85490356-64aa-48e4-8752-bf2b0ea7865f tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:47:58.653998 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-85490356-64aa-48e4-8752-bf2b0ea7865f tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "POST /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69/action" status: 200 len: 14 microversion: 2.1 time: 0.112835 Feb 17 04:47:58.654707 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 523/1045] 10.222.0.38 () {60 vars in 1268 bytes} [Wed Feb 17 04:47:58 2021] POST /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69/action => generated 14 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 04:47:59.252527 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [req-2265b25f-19c8-4daa-a724-ecf0ac9054fe req-1d1e263b-2a93-46df-88b2-d51837eadec0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed61fd7e-829e-4928-8dc9-4597d4d49aec", "tag": "d7b71187-da26-482f-8eed-c8aacdbbf7ab"}]} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:47:59.254642 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:47:59.254642 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:47:59.265637 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-2265b25f-19c8-4daa-a724-ecf0ac9054fe req-1d1e263b-2a93-46df-88b2-d51837eadec0 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:47:59.266139 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-2265b25f-19c8-4daa-a724-ecf0ac9054fe req-1d1e263b-2a93-46df-88b2-d51837eadec0 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:47:59.286507 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-26a43e3e-7151-4b77-a459-54e5450e0ab0 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:47:59.287328 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-26a43e3e-7151-4b77-a459-54e5450e0ab0 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] [instance: ed61fd7e-829e-4928-8dc9-4597d4d49aec] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:47:59.287838 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.compute.server_external_events [req-2265b25f-19c8-4daa-a724-ecf0ac9054fe req-1d1e263b-2a93-46df-88b2-d51837eadec0 service nova] Creating event network-changed:d7b71187-da26-482f-8eed-c8aacdbbf7ab for instance ed61fd7e-829e-4928-8dc9-4597d4d49aec on hv-cinder-76019 Feb 17 04:47:59.294085 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [req-2265b25f-19c8-4daa-a724-ecf0ac9054fe req-1d1e263b-2a93-46df-88b2-d51837eadec0 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044595 Feb 17 04:47:59.294828 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 523/1046] 10.222.0.38 () {64 vars in 1308 bytes} [Wed Feb 17 04:47:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:47:59.298598 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-26a43e3e-7151-4b77-a459-54e5450e0ab0 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:47:59.299124 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-26a43e3e-7151-4b77-a459-54e5450e0ab0 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:47:59.299971 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-26a43e3e-7151-4b77-a459-54e5450e0ab0 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:47:59.300709 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-26a43e3e-7151-4b77-a459-54e5450e0ab0 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:47:59.666372 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-6aea0f1a-9b7f-4093-b67a-38beb0745008 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:47:59.667579 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-6aea0f1a-9b7f-4093-b67a-38beb0745008 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: d62edd91-1355-4cb6-875b-86f12f404a69] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:47:59.675602 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6aea0f1a-9b7f-4093-b67a-38beb0745008 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:47:59.676109 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6aea0f1a-9b7f-4093-b67a-38beb0745008 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:47:59.676953 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6aea0f1a-9b7f-4093-b67a-38beb0745008 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:47:59.677446 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6aea0f1a-9b7f-4093-b67a-38beb0745008 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:47:59.704259 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-26a43e3e-7151-4b77-a459-54e5450e0ab0 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f25433642c4ea1996f8b1da7bf21d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cb524e7a8d4981b00474e1d9ed2062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:47:59.713493 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-26a43e3e-7151-4b77-a459-54e5450e0ab0 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] 10.222.0.38 "GET /compute/v2.1/servers/ed61fd7e-829e-4928-8dc9-4597d4d49aec" status: 200 len: 1274 microversion: 2.1 time: 0.431731 Feb 17 04:47:59.714094 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 524/1047] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:47:59 2021] GET /compute/v2.1/servers/ed61fd7e-829e-4928-8dc9-4597d4d49aec => generated 1274 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:47:59.774651 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-6aea0f1a-9b7f-4093-b67a-38beb0745008 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "POST /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69/action" status: 200 len: 14 microversion: 2.1 time: 0.112421 Feb 17 04:47:59.779646 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 524/1048] 10.222.0.38 () {60 vars in 1268 bytes} [Wed Feb 17 04:47:59 2021] POST /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69/action => generated 14 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Feb 17 04:48:00.732994 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-a840ff8f-05be-4fc2-ab81-532f45596585 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:48:00.733672 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-a840ff8f-05be-4fc2-ab81-532f45596585 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] [instance: ed61fd7e-829e-4928-8dc9-4597d4d49aec] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:48:00.742098 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a840ff8f-05be-4fc2-ab81-532f45596585 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:00.742661 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a840ff8f-05be-4fc2-ab81-532f45596585 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:00.743522 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a840ff8f-05be-4fc2-ab81-532f45596585 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:00.744029 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a840ff8f-05be-4fc2-ab81-532f45596585 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:00.788398 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-36c299e1-8cc6-4536-b74f-e6b58911baef tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:48:00.789473 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-36c299e1-8cc6-4536-b74f-e6b58911baef tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: d62edd91-1355-4cb6-875b-86f12f404a69] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:48:00.798789 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-36c299e1-8cc6-4536-b74f-e6b58911baef tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:00.799580 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-36c299e1-8cc6-4536-b74f-e6b58911baef tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:00.800141 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-36c299e1-8cc6-4536-b74f-e6b58911baef tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:00.800640 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-36c299e1-8cc6-4536-b74f-e6b58911baef tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:00.916261 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-36c299e1-8cc6-4536-b74f-e6b58911baef tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "POST /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69/action" status: 200 len: 6314 microversion: 2.1 time: 0.132115 Feb 17 04:48:00.917894 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 525/1049] 10.222.0.38 () {60 vars in 1268 bytes} [Wed Feb 17 04:48:00 2021] POST /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69/action => generated 6314 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:48:01.159393 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-a840ff8f-05be-4fc2-ab81-532f45596585 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f25433642c4ea1996f8b1da7bf21d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cb524e7a8d4981b00474e1d9ed2062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:48:01.169156 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-a840ff8f-05be-4fc2-ab81-532f45596585 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] 10.222.0.38 "GET /compute/v2.1/servers/ed61fd7e-829e-4928-8dc9-4597d4d49aec" status: 200 len: 1274 microversion: 2.1 time: 0.441015 Feb 17 04:48:01.169772 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 525/1050] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:48:00 2021] GET /compute/v2.1/servers/ed61fd7e-829e-4928-8dc9-4597d4d49aec => generated 1274 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:48:01.928900 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-826f4360-164c-4989-ac05-05967489b9f2 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:48:01.930028 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-826f4360-164c-4989-ac05-05967489b9f2 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: d62edd91-1355-4cb6-875b-86f12f404a69] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:48:01.938915 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-826f4360-164c-4989-ac05-05967489b9f2 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:01.939421 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-826f4360-164c-4989-ac05-05967489b9f2 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:01.940251 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-826f4360-164c-4989-ac05-05967489b9f2 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:01.940742 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-826f4360-164c-4989-ac05-05967489b9f2 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:02.050557 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-826f4360-164c-4989-ac05-05967489b9f2 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "POST /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69/action" status: 200 len: 15025 microversion: 2.1 time: 0.125909 Feb 17 04:48:02.051340 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 526/1051] 10.222.0.38 () {60 vars in 1268 bytes} [Wed Feb 17 04:48:01 2021] POST /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69/action => generated 15025 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:48:02.186868 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-8a2b6602-96cd-44c8-8820-1916ad1d27f0 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:48:02.187475 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-8a2b6602-96cd-44c8-8820-1916ad1d27f0 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] [instance: ed61fd7e-829e-4928-8dc9-4597d4d49aec] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:48:02.195410 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8a2b6602-96cd-44c8-8820-1916ad1d27f0 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:02.195919 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8a2b6602-96cd-44c8-8820-1916ad1d27f0 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:02.196752 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8a2b6602-96cd-44c8-8820-1916ad1d27f0 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:02.197254 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8a2b6602-96cd-44c8-8820-1916ad1d27f0 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:02.407250 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-8a2b6602-96cd-44c8-8820-1916ad1d27f0 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f25433642c4ea1996f8b1da7bf21d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cb524e7a8d4981b00474e1d9ed2062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:48:02.416081 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-8a2b6602-96cd-44c8-8820-1916ad1d27f0 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] 10.222.0.38 "GET /compute/v2.1/servers/ed61fd7e-829e-4928-8dc9-4597d4d49aec" status: 200 len: 1274 microversion: 2.1 time: 0.234137 Feb 17 04:48:02.416684 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 526/1052] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:48:02 2021] GET /compute/v2.1/servers/ed61fd7e-829e-4928-8dc9-4597d4d49aec => generated 1274 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:48:03.064382 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-df39f916-af5a-42bd-b591-7e4691883c70 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:48:03.065525 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-df39f916-af5a-42bd-b591-7e4691883c70 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: d62edd91-1355-4cb6-875b-86f12f404a69] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:48:03.074816 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-df39f916-af5a-42bd-b591-7e4691883c70 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:03.075336 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-df39f916-af5a-42bd-b591-7e4691883c70 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:03.076213 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-df39f916-af5a-42bd-b591-7e4691883c70 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:03.076716 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-df39f916-af5a-42bd-b591-7e4691883c70 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:03.182144 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-df39f916-af5a-42bd-b591-7e4691883c70 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "POST /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69/action" status: 200 len: 18663 microversion: 2.1 time: 0.122017 Feb 17 04:48:03.183871 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 527/1053] 10.222.0.38 () {60 vars in 1268 bytes} [Wed Feb 17 04:48:03 2021] POST /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69/action => generated 18663 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:48:03.435146 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-604f3d01-28f9-4664-bae5-b0e2e3b3bac4 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:48:03.435768 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-604f3d01-28f9-4664-bae5-b0e2e3b3bac4 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] [instance: ed61fd7e-829e-4928-8dc9-4597d4d49aec] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:48:03.443829 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-604f3d01-28f9-4664-bae5-b0e2e3b3bac4 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:03.444350 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-604f3d01-28f9-4664-bae5-b0e2e3b3bac4 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:03.445197 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-604f3d01-28f9-4664-bae5-b0e2e3b3bac4 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:03.445696 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-604f3d01-28f9-4664-bae5-b0e2e3b3bac4 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:03.655365 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-604f3d01-28f9-4664-bae5-b0e2e3b3bac4 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f25433642c4ea1996f8b1da7bf21d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cb524e7a8d4981b00474e1d9ed2062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:48:03.664402 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-604f3d01-28f9-4664-bae5-b0e2e3b3bac4 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] 10.222.0.38 "GET /compute/v2.1/servers/ed61fd7e-829e-4928-8dc9-4597d4d49aec" status: 200 len: 1274 microversion: 2.1 time: 0.233986 Feb 17 04:48:03.665008 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 527/1054] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:48:03 2021] GET /compute/v2.1/servers/ed61fd7e-829e-4928-8dc9-4597d4d49aec => generated 1274 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:48:04.194734 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-286f724f-ecae-4fb9-a14c-c5874b441660 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:48:04.195869 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-286f724f-ecae-4fb9-a14c-c5874b441660 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: d62edd91-1355-4cb6-875b-86f12f404a69] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:48:04.204647 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-286f724f-ecae-4fb9-a14c-c5874b441660 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:04.205154 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-286f724f-ecae-4fb9-a14c-c5874b441660 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:04.205986 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-286f724f-ecae-4fb9-a14c-c5874b441660 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:04.206475 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-286f724f-ecae-4fb9-a14c-c5874b441660 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:04.313097 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-286f724f-ecae-4fb9-a14c-c5874b441660 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "POST /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69/action" status: 200 len: 20997 microversion: 2.1 time: 0.122408 Feb 17 04:48:04.313702 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 528/1055] 10.222.0.38 () {60 vars in 1268 bytes} [Wed Feb 17 04:48:04 2021] POST /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69/action => generated 20997 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:48:04.684071 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-9e49b6b2-8286-4592-833b-5ba93ee86bde tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:48:04.684791 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-9e49b6b2-8286-4592-833b-5ba93ee86bde tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] [instance: ed61fd7e-829e-4928-8dc9-4597d4d49aec] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:48:04.692716 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9e49b6b2-8286-4592-833b-5ba93ee86bde tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:04.693233 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9e49b6b2-8286-4592-833b-5ba93ee86bde tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:04.694073 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9e49b6b2-8286-4592-833b-5ba93ee86bde tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:04.694595 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9e49b6b2-8286-4592-833b-5ba93ee86bde tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:04.906947 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-9e49b6b2-8286-4592-833b-5ba93ee86bde tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f25433642c4ea1996f8b1da7bf21d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cb524e7a8d4981b00474e1d9ed2062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:48:04.916630 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-9e49b6b2-8286-4592-833b-5ba93ee86bde tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] 10.222.0.38 "GET /compute/v2.1/servers/ed61fd7e-829e-4928-8dc9-4597d4d49aec" status: 200 len: 1274 microversion: 2.1 time: 0.237471 Feb 17 04:48:04.917016 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 528/1056] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:48:04 2021] GET /compute/v2.1/servers/ed61fd7e-829e-4928-8dc9-4597d4d49aec => generated 1274 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:48:05.326009 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-ede1fff2-eeb9-4e47-9ffb-fca73d2c89c8 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:48:05.327107 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-ede1fff2-eeb9-4e47-9ffb-fca73d2c89c8 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: d62edd91-1355-4cb6-875b-86f12f404a69] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:48:05.335572 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ede1fff2-eeb9-4e47-9ffb-fca73d2c89c8 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:05.336083 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ede1fff2-eeb9-4e47-9ffb-fca73d2c89c8 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:05.336913 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ede1fff2-eeb9-4e47-9ffb-fca73d2c89c8 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:05.337408 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ede1fff2-eeb9-4e47-9ffb-fca73d2c89c8 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:05.449838 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-ede1fff2-eeb9-4e47-9ffb-fca73d2c89c8 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "POST /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69/action" status: 200 len: 22981 microversion: 2.1 time: 0.128532 Feb 17 04:48:05.450522 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 529/1057] 10.222.0.38 () {60 vars in 1268 bytes} [Wed Feb 17 04:48:05 2021] POST /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69/action => generated 22981 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:48:05.935939 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-c9192221-ff35-45e1-a222-cf01c71e8f69 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:48:05.936609 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-c9192221-ff35-45e1-a222-cf01c71e8f69 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] [instance: ed61fd7e-829e-4928-8dc9-4597d4d49aec] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:48:05.944472 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c9192221-ff35-45e1-a222-cf01c71e8f69 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:05.945021 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c9192221-ff35-45e1-a222-cf01c71e8f69 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:05.945855 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c9192221-ff35-45e1-a222-cf01c71e8f69 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:05.946350 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c9192221-ff35-45e1-a222-cf01c71e8f69 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:06.161983 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-c9192221-ff35-45e1-a222-cf01c71e8f69 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f25433642c4ea1996f8b1da7bf21d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cb524e7a8d4981b00474e1d9ed2062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:48:06.171236 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-c9192221-ff35-45e1-a222-cf01c71e8f69 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] 10.222.0.38 "GET /compute/v2.1/servers/ed61fd7e-829e-4928-8dc9-4597d4d49aec" status: 200 len: 1274 microversion: 2.1 time: 0.240200 Feb 17 04:48:06.171871 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 529/1058] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:48:05 2021] GET /compute/v2.1/servers/ed61fd7e-829e-4928-8dc9-4597d4d49aec => generated 1274 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:48:06.462518 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-19aa0486-18fd-48b0-9b7a-ff55c6a8fa23 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:48:06.463693 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-19aa0486-18fd-48b0-9b7a-ff55c6a8fa23 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: d62edd91-1355-4cb6-875b-86f12f404a69] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:48:06.473164 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-19aa0486-18fd-48b0-9b7a-ff55c6a8fa23 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:06.473684 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-19aa0486-18fd-48b0-9b7a-ff55c6a8fa23 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:06.474523 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-19aa0486-18fd-48b0-9b7a-ff55c6a8fa23 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:06.475054 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-19aa0486-18fd-48b0-9b7a-ff55c6a8fa23 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:06.583182 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-19aa0486-18fd-48b0-9b7a-ff55c6a8fa23 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "POST /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69/action" status: 200 len: 23804 microversion: 2.1 time: 0.124998 Feb 17 04:48:06.583873 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 530/1059] 10.222.0.38 () {60 vars in 1268 bytes} [Wed Feb 17 04:48:06 2021] POST /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69/action => generated 23804 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:48:07.189479 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-5d9d5535-a846-489c-9941-9a2ce46d56e6 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:48:07.190168 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-5d9d5535-a846-489c-9941-9a2ce46d56e6 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] [instance: ed61fd7e-829e-4928-8dc9-4597d4d49aec] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:48:07.198128 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5d9d5535-a846-489c-9941-9a2ce46d56e6 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:07.198672 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5d9d5535-a846-489c-9941-9a2ce46d56e6 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:07.200046 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5d9d5535-a846-489c-9941-9a2ce46d56e6 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:07.200551 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5d9d5535-a846-489c-9941-9a2ce46d56e6 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:07.413938 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-5d9d5535-a846-489c-9941-9a2ce46d56e6 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f25433642c4ea1996f8b1da7bf21d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cb524e7a8d4981b00474e1d9ed2062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:48:07.422973 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-5d9d5535-a846-489c-9941-9a2ce46d56e6 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] 10.222.0.38 "GET /compute/v2.1/servers/ed61fd7e-829e-4928-8dc9-4597d4d49aec" status: 200 len: 1274 microversion: 2.1 time: 0.237406 Feb 17 04:48:07.423580 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 530/1060] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:48:07 2021] GET /compute/v2.1/servers/ed61fd7e-829e-4928-8dc9-4597d4d49aec => generated 1274 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:48:07.518044 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [req-037b19f0-e2e0-441b-9559-d0b357911de9 req-f5041768-3044-4835-9f00-e3102949d128 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed61fd7e-829e-4928-8dc9-4597d4d49aec", "name": "network-vif-plugged", "status": "completed", "tag": "d7b71187-da26-482f-8eed-c8aacdbbf7ab"}]} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:48:07.519919 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:48:07.519919 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:48:07.530846 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-037b19f0-e2e0-441b-9559-d0b357911de9 req-f5041768-3044-4835-9f00-e3102949d128 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:07.531436 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-037b19f0-e2e0-441b-9559-d0b357911de9 req-f5041768-3044-4835-9f00-e3102949d128 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:07.549005 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.compute.server_external_events [req-037b19f0-e2e0-441b-9559-d0b357911de9 req-f5041768-3044-4835-9f00-e3102949d128 service nova] Creating event network-vif-plugged:d7b71187-da26-482f-8eed-c8aacdbbf7ab for instance ed61fd7e-829e-4928-8dc9-4597d4d49aec on hv-cinder-76019 Feb 17 04:48:07.553917 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [req-037b19f0-e2e0-441b-9559-d0b357911de9 req-f5041768-3044-4835-9f00-e3102949d128 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040534 Feb 17 04:48:07.554594 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 531/1061] 10.222.0.38 () {64 vars in 1308 bytes} [Wed Feb 17 04:48:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:48:07.595914 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-59409fb4-94af-4263-b585-98a6a651c6ab tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:48:07.597105 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-59409fb4-94af-4263-b585-98a6a651c6ab tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: d62edd91-1355-4cb6-875b-86f12f404a69] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:48:07.607908 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-59409fb4-94af-4263-b585-98a6a651c6ab tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:07.608420 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-59409fb4-94af-4263-b585-98a6a651c6ab tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:07.609270 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-59409fb4-94af-4263-b585-98a6a651c6ab tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:07.609763 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-59409fb4-94af-4263-b585-98a6a651c6ab tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:07.724328 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-59409fb4-94af-4263-b585-98a6a651c6ab tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "POST /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69/action" status: 200 len: 25444 microversion: 2.1 time: 0.132422 Feb 17 04:48:07.725299 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 531/1062] 10.222.0.38 () {60 vars in 1268 bytes} [Wed Feb 17 04:48:07 2021] POST /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69/action => generated 25444 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:48:08.442149 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-ba4c892e-ef1a-42a9-96b9-2638e2b914a9 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:48:08.442953 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-ba4c892e-ef1a-42a9-96b9-2638e2b914a9 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] [instance: ed61fd7e-829e-4928-8dc9-4597d4d49aec] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:48:08.451225 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ba4c892e-ef1a-42a9-96b9-2638e2b914a9 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:08.451741 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ba4c892e-ef1a-42a9-96b9-2638e2b914a9 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:08.452582 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ba4c892e-ef1a-42a9-96b9-2638e2b914a9 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:08.453084 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ba4c892e-ef1a-42a9-96b9-2638e2b914a9 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:08.663564 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-ba4c892e-ef1a-42a9-96b9-2638e2b914a9 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f25433642c4ea1996f8b1da7bf21d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cb524e7a8d4981b00474e1d9ed2062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:48:08.672798 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-ba4c892e-ef1a-42a9-96b9-2638e2b914a9 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] 10.222.0.38 "GET /compute/v2.1/servers/ed61fd7e-829e-4928-8dc9-4597d4d49aec" status: 200 len: 1274 microversion: 2.1 time: 0.235180 Feb 17 04:48:08.673397 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 532/1063] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:48:08 2021] GET /compute/v2.1/servers/ed61fd7e-829e-4928-8dc9-4597d4d49aec => generated 1274 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:48:08.737341 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-ea5c7851-230a-45ce-990c-3166dd3db62e tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:48:08.738414 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-ea5c7851-230a-45ce-990c-3166dd3db62e tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: d62edd91-1355-4cb6-875b-86f12f404a69] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:48:08.747435 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ea5c7851-230a-45ce-990c-3166dd3db62e tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:08.747943 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ea5c7851-230a-45ce-990c-3166dd3db62e tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:08.748789 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ea5c7851-230a-45ce-990c-3166dd3db62e tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:08.749283 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ea5c7851-230a-45ce-990c-3166dd3db62e tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:08.877599 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-ea5c7851-230a-45ce-990c-3166dd3db62e tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "POST /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69/action" status: 200 len: 26713 microversion: 2.1 time: 0.144548 Feb 17 04:48:08.878307 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 532/1064] 10.222.0.38 () {60 vars in 1268 bytes} [Wed Feb 17 04:48:08 2021] POST /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69/action => generated 26713 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:48:09.691159 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-61cf1e59-a359-434a-a92b-e17589f22978 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:48:09.691802 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-61cf1e59-a359-434a-a92b-e17589f22978 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] [instance: ed61fd7e-829e-4928-8dc9-4597d4d49aec] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:48:09.699712 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-61cf1e59-a359-434a-a92b-e17589f22978 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:09.700220 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-61cf1e59-a359-434a-a92b-e17589f22978 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:09.701065 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-61cf1e59-a359-434a-a92b-e17589f22978 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:09.701562 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-61cf1e59-a359-434a-a92b-e17589f22978 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:09.891209 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-4cbf37d8-3c83-4392-9e20-4114cb83ac4c tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:48:09.892353 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-4cbf37d8-3c83-4392-9e20-4114cb83ac4c tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: d62edd91-1355-4cb6-875b-86f12f404a69] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:48:09.901018 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4cbf37d8-3c83-4392-9e20-4114cb83ac4c tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:09.901532 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4cbf37d8-3c83-4392-9e20-4114cb83ac4c tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:09.902370 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4cbf37d8-3c83-4392-9e20-4114cb83ac4c tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:09.903003 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4cbf37d8-3c83-4392-9e20-4114cb83ac4c tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:09.917503 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-61cf1e59-a359-434a-a92b-e17589f22978 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f25433642c4ea1996f8b1da7bf21d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cb524e7a8d4981b00474e1d9ed2062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:48:09.926622 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-61cf1e59-a359-434a-a92b-e17589f22978 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] 10.222.0.38 "GET /compute/v2.1/servers/ed61fd7e-829e-4928-8dc9-4597d4d49aec" status: 200 len: 1460 microversion: 2.1 time: 0.239581 Feb 17 04:48:09.927225 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 533/1065] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:48:09 2021] GET /compute/v2.1/servers/ed61fd7e-829e-4928-8dc9-4597d4d49aec => generated 1460 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:48:09.944360 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-b5533968-f20a-49b2-be05-7221c60efa32 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:48:09.945040 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-b5533968-f20a-49b2-be05-7221c60efa32 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] [instance: ed61fd7e-829e-4928-8dc9-4597d4d49aec] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:48:09.953841 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b5533968-f20a-49b2-be05-7221c60efa32 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:09.954007 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b5533968-f20a-49b2-be05-7221c60efa32 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:09.954957 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b5533968-f20a-49b2-be05-7221c60efa32 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:09.955936 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-b5533968-f20a-49b2-be05-7221c60efa32 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:10.020754 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-4cbf37d8-3c83-4392-9e20-4114cb83ac4c tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "POST /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69/action" status: 200 len: 27642 microversion: 2.1 time: 0.134489 Feb 17 04:48:10.021698 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 533/1066] 10.222.0.38 () {60 vars in 1268 bytes} [Wed Feb 17 04:48:09 2021] POST /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69/action => generated 27642 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 04:48:10.168801 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-b5533968-f20a-49b2-be05-7221c60efa32 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f25433642c4ea1996f8b1da7bf21d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cb524e7a8d4981b00474e1d9ed2062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:48:10.177831 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-b5533968-f20a-49b2-be05-7221c60efa32 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] 10.222.0.38 "GET /compute/v2.1/servers/ed61fd7e-829e-4928-8dc9-4597d4d49aec" status: 200 len: 1460 microversion: 2.1 time: 0.237377 Feb 17 04:48:10.178434 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 534/1067] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:48:09 2021] GET /compute/v2.1/servers/ed61fd7e-829e-4928-8dc9-4597d4d49aec => generated 1460 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:48:10.197331 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-f6083c76-ac16-4e73-bb2d-80f06b1c4b3c tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Action: 'create', calling method: .version_select at 0x7fc2e9dd92f0>, body: {"pool": null} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:48:11.034122 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-2bc3a11d-c0d1-420c-85b1-92f8c6ea51fc tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:48:11.035255 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-2bc3a11d-c0d1-420c-85b1-92f8c6ea51fc tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: d62edd91-1355-4cb6-875b-86f12f404a69] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:48:11.043704 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2bc3a11d-c0d1-420c-85b1-92f8c6ea51fc tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:11.044272 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2bc3a11d-c0d1-420c-85b1-92f8c6ea51fc tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:11.045165 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2bc3a11d-c0d1-420c-85b1-92f8c6ea51fc tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:11.045611 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-2bc3a11d-c0d1-420c-85b1-92f8c6ea51fc tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:11.160018 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-2bc3a11d-c0d1-420c-85b1-92f8c6ea51fc tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "POST /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69/action" status: 200 len: 28167 microversion: 2.1 time: 0.129763 Feb 17 04:48:11.160788 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 535/1068] 10.222.0.38 () {60 vars in 1268 bytes} [Wed Feb 17 04:48:11 2021] POST /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69/action => generated 28167 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 04:48:12.173774 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-20a7239f-2b88-42b2-a775-f6004f129d95 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:48:12.174959 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-20a7239f-2b88-42b2-a775-f6004f129d95 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: d62edd91-1355-4cb6-875b-86f12f404a69] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:48:12.183562 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-20a7239f-2b88-42b2-a775-f6004f129d95 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:12.184846 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-20a7239f-2b88-42b2-a775-f6004f129d95 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:12.185697 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-20a7239f-2b88-42b2-a775-f6004f129d95 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:12.186202 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-20a7239f-2b88-42b2-a775-f6004f129d95 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:12.303604 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-20a7239f-2b88-42b2-a775-f6004f129d95 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "POST /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69/action" status: 200 len: 28252 microversion: 2.1 time: 0.134241 Feb 17 04:48:12.308123 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 536/1069] 10.222.0.38 () {60 vars in 1268 bytes} [Wed Feb 17 04:48:12 2021] POST /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69/action => generated 28252 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 04:48:12.418848 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-f6083c76-ac16-4e73-bb2d-80f06b1c4b3c tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] 10.222.0.38 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.225396 Feb 17 04:48:12.419509 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 534/1070] 10.222.0.38 () {60 vars in 1160 bytes} [Wed Feb 17 04:48:10 2021] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:48:12.431681 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-97abecd5-fb5d-4867-b052-d0ed731305fe tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.27.0.61"}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:48:12.432965 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-97abecd5-fb5d-4867-b052-d0ed731305fe tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] [instance: ed61fd7e-829e-4928-8dc9-4597d4d49aec] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:48:12.442488 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-97abecd5-fb5d-4867-b052-d0ed731305fe tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:12.443063 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-97abecd5-fb5d-4867-b052-d0ed731305fe tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:12.443894 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-97abecd5-fb5d-4867-b052-d0ed731305fe tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:12.444379 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-97abecd5-fb5d-4867-b052-d0ed731305fe tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:12.508771 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-97abecd5-fb5d-4867-b052-d0ed731305fe tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Acquired lock "refresh_cache-ed61fd7e-829e-4928-8dc9-4597d4d49aec" {{(pid=98080) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Feb 17 04:48:13.317009 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-7aaa829e-c927-4c51-af8c-105fda8f53cc tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:48:13.318268 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-7aaa829e-c927-4c51-af8c-105fda8f53cc tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: d62edd91-1355-4cb6-875b-86f12f404a69] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:48:13.327166 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7aaa829e-c927-4c51-af8c-105fda8f53cc tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:13.327684 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7aaa829e-c927-4c51-af8c-105fda8f53cc tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:13.328527 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7aaa829e-c927-4c51-af8c-105fda8f53cc tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:13.329021 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7aaa829e-c927-4c51-af8c-105fda8f53cc tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:13.442125 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-7aaa829e-c927-4c51-af8c-105fda8f53cc tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "POST /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69/action" status: 200 len: 28543 microversion: 2.1 time: 0.129318 Feb 17 04:48:13.443110 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 535/1071] 10.222.0.38 () {60 vars in 1268 bytes} [Wed Feb 17 04:48:13 2021] POST /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69/action => generated 28543 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 04:48:14.258484 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.network.neutron [None req-97abecd5-fb5d-4867-b052-d0ed731305fe tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] [instance: ed61fd7e-829e-4928-8dc9-4597d4d49aec] Building network info cache for instance {{(pid=98080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1836}} Feb 17 04:48:14.269338 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [req-3064746d-a147-4f85-9fbb-adf26c669f6f req-77717eca-e92a-4cdf-91e0-e64f4a498aad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed61fd7e-829e-4928-8dc9-4597d4d49aec", "tag": "d7b71187-da26-482f-8eed-c8aacdbbf7ab"}]} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:48:14.271325 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:48:14.271325 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:48:14.281559 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-3064746d-a147-4f85-9fbb-adf26c669f6f req-77717eca-e92a-4cdf-91e0-e64f4a498aad service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:14.282170 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-3064746d-a147-4f85-9fbb-adf26c669f6f req-77717eca-e92a-4cdf-91e0-e64f4a498aad service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:14.300554 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.compute.server_external_events [req-3064746d-a147-4f85-9fbb-adf26c669f6f req-77717eca-e92a-4cdf-91e0-e64f4a498aad service nova] Creating event network-changed:d7b71187-da26-482f-8eed-c8aacdbbf7ab for instance ed61fd7e-829e-4928-8dc9-4597d4d49aec on hv-cinder-76019 Feb 17 04:48:14.305849 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [req-3064746d-a147-4f85-9fbb-adf26c669f6f req-77717eca-e92a-4cdf-91e0-e64f4a498aad service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040991 Feb 17 04:48:14.306850 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 536/1072] 10.222.0.38 () {64 vars in 1308 bytes} [Wed Feb 17 04:48:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:48:14.455134 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-d0112037-af86-4cee-a272-9b434fa42c23 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:48:14.456347 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-d0112037-af86-4cee-a272-9b434fa42c23 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: d62edd91-1355-4cb6-875b-86f12f404a69] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:48:14.464394 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d0112037-af86-4cee-a272-9b434fa42c23 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:14.465422 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d0112037-af86-4cee-a272-9b434fa42c23 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:14.467241 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d0112037-af86-4cee-a272-9b434fa42c23 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:14.467750 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d0112037-af86-4cee-a272-9b434fa42c23 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:14.586949 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-d0112037-af86-4cee-a272-9b434fa42c23 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "POST /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69/action" status: 200 len: 28711 microversion: 2.1 time: 0.136123 Feb 17 04:48:14.587910 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 537/1073] 10.222.0.38 () {60 vars in 1268 bytes} [Wed Feb 17 04:48:14 2021] POST /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69/action => generated 28711 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 04:48:15.601275 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-5ba1ef69-9708-4b39-8b99-54f3fb3549a7 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:48:15.603070 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-5ba1ef69-9708-4b39-8b99-54f3fb3549a7 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: d62edd91-1355-4cb6-875b-86f12f404a69] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:48:15.612094 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5ba1ef69-9708-4b39-8b99-54f3fb3549a7 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:15.612606 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5ba1ef69-9708-4b39-8b99-54f3fb3549a7 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:15.613456 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5ba1ef69-9708-4b39-8b99-54f3fb3549a7 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:15.613945 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5ba1ef69-9708-4b39-8b99-54f3fb3549a7 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:15.716911 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-5ba1ef69-9708-4b39-8b99-54f3fb3549a7 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "POST /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69/action" status: 200 len: 28711 microversion: 2.1 time: 0.119937 Feb 17 04:48:15.721081 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 538/1074] 10.222.0.38 () {60 vars in 1268 bytes} [Wed Feb 17 04:48:15 2021] POST /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69/action => generated 28711 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:48:15.979962 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.network.neutron [None req-97abecd5-fb5d-4867-b052-d0ed731305fe tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] [instance: ed61fd7e-829e-4928-8dc9-4597d4d49aec] Updating instance_info_cache with network_info: [{"id": "d7b71187-da26-482f-8eed-c8aacdbbf7ab", "address": "fa:16:3e:a3:29:4a", "network": {"id": "a877ef56-9526-4e88-a555-4c4a4c974334", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-239973466-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.27.0.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "01cb524e7a8d4981b00474e1d9ed2062", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tapd7b71187-da", "ovs_interfaceid": "d7b71187-da26-482f-8eed-c8aacdbbf7ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=98080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Feb 17 04:48:15.993183 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-97abecd5-fb5d-4867-b052-d0ed731305fe tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Releasing lock "refresh_cache-ed61fd7e-829e-4928-8dc9-4597d4d49aec" {{(pid=98080) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Feb 17 04:48:15.994446 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-97abecd5-fb5d-4867-b052-d0ed731305fe tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] 10.222.0.38 "POST /compute/v2.1/servers/ed61fd7e-829e-4928-8dc9-4597d4d49aec/action" status: 202 len: 0 microversion: 2.1 time: 3.566921 Feb 17 04:48:15.995317 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 537/1075] 10.222.0.38 () {60 vars in 1268 bytes} [Wed Feb 17 04:48:12 2021] POST /compute/v2.1/servers/ed61fd7e-829e-4928-8dc9-4597d4d49aec/action => generated 0 bytes in 3569 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Feb 17 04:48:16.729921 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-f8b6cf2a-ff3f-4c46-ab1e-3ba0e4fbd033 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:48:16.731157 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-f8b6cf2a-ff3f-4c46-ab1e-3ba0e4fbd033 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: d62edd91-1355-4cb6-875b-86f12f404a69] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:48:16.739731 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f8b6cf2a-ff3f-4c46-ab1e-3ba0e4fbd033 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:16.740237 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f8b6cf2a-ff3f-4c46-ab1e-3ba0e4fbd033 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:16.741068 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f8b6cf2a-ff3f-4c46-ab1e-3ba0e4fbd033 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:16.741559 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f8b6cf2a-ff3f-4c46-ab1e-3ba0e4fbd033 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:16.848282 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-f8b6cf2a-ff3f-4c46-ab1e-3ba0e4fbd033 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "POST /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69/action" status: 200 len: 28711 microversion: 2.1 time: 0.122595 Feb 17 04:48:16.848974 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 539/1076] 10.222.0.38 () {60 vars in 1268 bytes} [Wed Feb 17 04:48:16 2021] POST /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69/action => generated 28711 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:48:17.861445 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-fab1707a-ed63-46aa-9eaf-4999a508acec tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:48:17.862669 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-fab1707a-ed63-46aa-9eaf-4999a508acec tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: d62edd91-1355-4cb6-875b-86f12f404a69] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:48:17.870679 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-fab1707a-ed63-46aa-9eaf-4999a508acec tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:17.871829 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-fab1707a-ed63-46aa-9eaf-4999a508acec tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:17.872698 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-fab1707a-ed63-46aa-9eaf-4999a508acec tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:17.873201 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-fab1707a-ed63-46aa-9eaf-4999a508acec tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:17.989795 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-fab1707a-ed63-46aa-9eaf-4999a508acec tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "POST /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69/action" status: 200 len: 29273 microversion: 2.1 time: 0.132307 Feb 17 04:48:17.994041 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 538/1077] 10.222.0.38 () {60 vars in 1268 bytes} [Wed Feb 17 04:48:17 2021] POST /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69/action => generated 29273 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:48:19.003690 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-dcaa23bd-e9d5-49f3-afa2-1dfb0e70b293 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:48:19.004875 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-dcaa23bd-e9d5-49f3-afa2-1dfb0e70b293 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: d62edd91-1355-4cb6-875b-86f12f404a69] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:48:19.015262 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-dcaa23bd-e9d5-49f3-afa2-1dfb0e70b293 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:19.016026 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-dcaa23bd-e9d5-49f3-afa2-1dfb0e70b293 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:19.016976 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-dcaa23bd-e9d5-49f3-afa2-1dfb0e70b293 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:19.017417 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-dcaa23bd-e9d5-49f3-afa2-1dfb0e70b293 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:19.137879 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-dcaa23bd-e9d5-49f3-afa2-1dfb0e70b293 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "POST /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69/action" status: 200 len: 31406 microversion: 2.1 time: 0.138589 Feb 17 04:48:19.138620 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 540/1078] 10.222.0.38 () {60 vars in 1268 bytes} [Wed Feb 17 04:48:18 2021] POST /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69/action => generated 31406 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:48:20.150993 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-d54908d5-8707-4ca0-933a-2dcf9a79d557 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:48:20.152812 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-d54908d5-8707-4ca0-933a-2dcf9a79d557 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: d62edd91-1355-4cb6-875b-86f12f404a69] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:48:20.161518 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d54908d5-8707-4ca0-933a-2dcf9a79d557 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:20.162041 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d54908d5-8707-4ca0-933a-2dcf9a79d557 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:20.162912 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d54908d5-8707-4ca0-933a-2dcf9a79d557 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:20.163417 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d54908d5-8707-4ca0-933a-2dcf9a79d557 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:20.283219 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-d54908d5-8707-4ca0-933a-2dcf9a79d557 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "POST /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69/action" status: 200 len: 33145 microversion: 2.1 time: 0.136413 Feb 17 04:48:20.283853 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 539/1079] 10.222.0.38 () {60 vars in 1268 bytes} [Wed Feb 17 04:48:20 2021] POST /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69/action => generated 33145 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:48:21.297603 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-e28d1e72-5d5e-4254-afaf-ef3062abcba7 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:48:21.298700 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-e28d1e72-5d5e-4254-afaf-ef3062abcba7 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: d62edd91-1355-4cb6-875b-86f12f404a69] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:48:21.307406 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e28d1e72-5d5e-4254-afaf-ef3062abcba7 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:21.307922 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e28d1e72-5d5e-4254-afaf-ef3062abcba7 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:21.309556 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e28d1e72-5d5e-4254-afaf-ef3062abcba7 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:21.310018 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e28d1e72-5d5e-4254-afaf-ef3062abcba7 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:21.423516 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-e28d1e72-5d5e-4254-afaf-ef3062abcba7 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "POST /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69/action" status: 200 len: 33972 microversion: 2.1 time: 0.131128 Feb 17 04:48:21.424206 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 541/1080] 10.222.0.38 () {60 vars in 1268 bytes} [Wed Feb 17 04:48:21 2021] POST /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69/action => generated 33972 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:48:22.437644 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-979f97b5-b4de-43e0-8965-e6000c617083 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:48:22.438817 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-979f97b5-b4de-43e0-8965-e6000c617083 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: d62edd91-1355-4cb6-875b-86f12f404a69] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:48:22.447420 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-979f97b5-b4de-43e0-8965-e6000c617083 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:22.447936 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-979f97b5-b4de-43e0-8965-e6000c617083 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:22.448783 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-979f97b5-b4de-43e0-8965-e6000c617083 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:22.450048 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-979f97b5-b4de-43e0-8965-e6000c617083 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:22.567010 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-979f97b5-b4de-43e0-8965-e6000c617083 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "POST /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69/action" status: 200 len: 35009 microversion: 2.1 time: 0.134516 Feb 17 04:48:22.567706 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 540/1081] 10.222.0.38 () {60 vars in 1268 bytes} [Wed Feb 17 04:48:22 2021] POST /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69/action => generated 35009 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:48:23.581096 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-36441d38-b27d-41ca-a0bf-bcdcd23f7b3b tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:48:23.582273 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-36441d38-b27d-41ca-a0bf-bcdcd23f7b3b tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: d62edd91-1355-4cb6-875b-86f12f404a69] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:48:23.591512 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-36441d38-b27d-41ca-a0bf-bcdcd23f7b3b tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:23.591998 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-36441d38-b27d-41ca-a0bf-bcdcd23f7b3b tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:23.592840 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-36441d38-b27d-41ca-a0bf-bcdcd23f7b3b tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:23.593335 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-36441d38-b27d-41ca-a0bf-bcdcd23f7b3b tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:23.709697 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-36441d38-b27d-41ca-a0bf-bcdcd23f7b3b tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "POST /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69/action" status: 200 len: 36063 microversion: 2.1 time: 0.133074 Feb 17 04:48:23.710299 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 542/1082] 10.222.0.38 () {60 vars in 1268 bytes} [Wed Feb 17 04:48:23 2021] POST /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69/action => generated 36063 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:48:24.722895 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-c82de2c9-b422-4b23-827e-36b700d39a5c tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:48:24.724032 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-c82de2c9-b422-4b23-827e-36b700d39a5c tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: d62edd91-1355-4cb6-875b-86f12f404a69] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:48:24.732718 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c82de2c9-b422-4b23-827e-36b700d39a5c tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:24.733223 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c82de2c9-b422-4b23-827e-36b700d39a5c tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:24.734058 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c82de2c9-b422-4b23-827e-36b700d39a5c tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:24.734550 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c82de2c9-b422-4b23-827e-36b700d39a5c tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:24.854232 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-c82de2c9-b422-4b23-827e-36b700d39a5c tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "POST /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69/action" status: 200 len: 37730 microversion: 2.1 time: 0.135703 Feb 17 04:48:24.855261 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 541/1083] 10.222.0.38 () {60 vars in 1268 bytes} [Wed Feb 17 04:48:24 2021] POST /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69/action => generated 37730 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:48:25.867890 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-d52ac3b1-fb0a-4483-801f-ccaf675597fa tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:48:25.869080 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-d52ac3b1-fb0a-4483-801f-ccaf675597fa tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: d62edd91-1355-4cb6-875b-86f12f404a69] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:48:25.878339 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d52ac3b1-fb0a-4483-801f-ccaf675597fa tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:25.878880 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d52ac3b1-fb0a-4483-801f-ccaf675597fa tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:25.879716 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d52ac3b1-fb0a-4483-801f-ccaf675597fa tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:25.880209 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d52ac3b1-fb0a-4483-801f-ccaf675597fa tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:25.993007 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-d52ac3b1-fb0a-4483-801f-ccaf675597fa tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "POST /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69/action" status: 200 len: 38245 microversion: 2.1 time: 0.129348 Feb 17 04:48:25.993982 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 543/1084] 10.222.0.38 () {60 vars in 1268 bytes} [Wed Feb 17 04:48:25 2021] POST /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69/action => generated 38245 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:48:27.012036 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-fcfc4dd4-9a10-4493-9289-06f30f04c9ae tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:48:27.013383 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-fcfc4dd4-9a10-4493-9289-06f30f04c9ae tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: d62edd91-1355-4cb6-875b-86f12f404a69] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:48:27.022121 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-fcfc4dd4-9a10-4493-9289-06f30f04c9ae tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:27.022660 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-fcfc4dd4-9a10-4493-9289-06f30f04c9ae tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:27.023519 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-fcfc4dd4-9a10-4493-9289-06f30f04c9ae tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:27.024023 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-fcfc4dd4-9a10-4493-9289-06f30f04c9ae tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:27.131519 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-fcfc4dd4-9a10-4493-9289-06f30f04c9ae tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "POST /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69/action" status: 200 len: 38245 microversion: 2.1 time: 0.128899 Feb 17 04:48:27.132503 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 542/1085] 10.222.0.38 () {60 vars in 1268 bytes} [Wed Feb 17 04:48:27 2021] POST /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69/action => generated 38245 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:48:28.144942 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-9b8e92f5-f701-4416-849d-da1bef10edbb tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:48:28.146071 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-9b8e92f5-f701-4416-849d-da1bef10edbb tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: d62edd91-1355-4cb6-875b-86f12f404a69] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:48:28.155468 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9b8e92f5-f701-4416-849d-da1bef10edbb tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:28.155976 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9b8e92f5-f701-4416-849d-da1bef10edbb tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:28.156809 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9b8e92f5-f701-4416-849d-da1bef10edbb tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:28.157319 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9b8e92f5-f701-4416-849d-da1bef10edbb tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:28.258322 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-9b8e92f5-f701-4416-849d-da1bef10edbb tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "POST /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69/action" status: 200 len: 38245 microversion: 2.1 time: 0.117607 Feb 17 04:48:28.258962 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 544/1086] 10.222.0.38 () {60 vars in 1268 bytes} [Wed Feb 17 04:48:28 2021] POST /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69/action => generated 38245 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:48:29.272709 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-e9f9ef8f-d51b-44f9-9d5f-cb25061664bb tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:48:29.273790 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-e9f9ef8f-d51b-44f9-9d5f-cb25061664bb tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: d62edd91-1355-4cb6-875b-86f12f404a69] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:48:29.283392 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e9f9ef8f-d51b-44f9-9d5f-cb25061664bb tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:29.283905 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e9f9ef8f-d51b-44f9-9d5f-cb25061664bb tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:29.284750 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e9f9ef8f-d51b-44f9-9d5f-cb25061664bb tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:29.285251 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e9f9ef8f-d51b-44f9-9d5f-cb25061664bb tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:29.401525 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-e9f9ef8f-d51b-44f9-9d5f-cb25061664bb tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "POST /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69/action" status: 200 len: 38376 microversion: 2.1 time: 0.133193 Feb 17 04:48:29.402767 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 543/1087] 10.222.0.38 () {60 vars in 1268 bytes} [Wed Feb 17 04:48:29 2021] POST /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69/action => generated 38376 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 04:48:29.414199 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-5ae1e5e4-905e-47c2-9eb4-be236bb8b7d6 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:48:29.414874 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-5ae1e5e4-905e-47c2-9eb4-be236bb8b7d6 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: d62edd91-1355-4cb6-875b-86f12f404a69] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:48:29.423987 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5ae1e5e4-905e-47c2-9eb4-be236bb8b7d6 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:29.424502 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5ae1e5e4-905e-47c2-9eb4-be236bb8b7d6 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:29.425338 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5ae1e5e4-905e-47c2-9eb4-be236bb8b7d6 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:29.425842 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5ae1e5e4-905e-47c2-9eb4-be236bb8b7d6 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:29.486705 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-5ae1e5e4-905e-47c2-9eb4-be236bb8b7d6 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "GET /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69/ips" status: 200 len: 146 microversion: 2.1 time: 0.076843 Feb 17 04:48:29.487339 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 545/1088] 10.222.0.38 () {58 vars in 1238 bytes} [Wed Feb 17 04:48:29 2021] GET /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69/ips => generated 146 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:48:31.041460 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-6ad1f8e6-a41b-459e-b3a8-3e0880935de6 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6c5ff71e-6c61-4ccb-8e5a-a06cb67559c8"}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:48:31.043409 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-6ad1f8e6-a41b-459e-b3a8-3e0880935de6 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: d62edd91-1355-4cb6-875b-86f12f404a69] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:48:31.052059 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6ad1f8e6-a41b-459e-b3a8-3e0880935de6 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:31.052582 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6ad1f8e6-a41b-459e-b3a8-3e0880935de6 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:31.053440 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6ad1f8e6-a41b-459e-b3a8-3e0880935de6 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:31.053948 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6ad1f8e6-a41b-459e-b3a8-3e0880935de6 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:31.423706 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-6ad1f8e6-a41b-459e-b3a8-3e0880935de6 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "POST /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.386634 Feb 17 04:48:31.424516 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 544/1089] 10.222.0.38 () {60 vars in 1313 bytes} [Wed Feb 17 04:48:31 2021] POST /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69/os-volume_attachments => generated 194 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:48:38.152712 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-5a62bee0-bd05-4971-aeab-17a86e4577cc tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:48:38.154455 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-5a62bee0-bd05-4971-aeab-17a86e4577cc tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: d62edd91-1355-4cb6-875b-86f12f404a69] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:48:38.162845 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5a62bee0-bd05-4971-aeab-17a86e4577cc tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:38.163358 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5a62bee0-bd05-4971-aeab-17a86e4577cc tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:38.164252 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5a62bee0-bd05-4971-aeab-17a86e4577cc tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:38.164758 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5a62bee0-bd05-4971-aeab-17a86e4577cc tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:38.233547 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-5a62bee0-bd05-4971-aeab-17a86e4577cc tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "GET /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084866 Feb 17 04:48:38.234159 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 546/1090] 10.222.0.38 () {58 vars in 1292 bytes} [Wed Feb 17 04:48:38 2021] GET /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:48:38.246450 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-120833a8-ef87-4fec-a455-bf89f47a8d36 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:48:38.247614 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-120833a8-ef87-4fec-a455-bf89f47a8d36 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: d62edd91-1355-4cb6-875b-86f12f404a69] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:48:38.256273 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-120833a8-ef87-4fec-a455-bf89f47a8d36 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:38.256792 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-120833a8-ef87-4fec-a455-bf89f47a8d36 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:38.257632 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-120833a8-ef87-4fec-a455-bf89f47a8d36 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:38.258132 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-120833a8-ef87-4fec-a455-bf89f47a8d36 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:38.329983 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-120833a8-ef87-4fec-a455-bf89f47a8d36 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "GET /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69/os-volume_attachments/6c5ff71e-6c61-4ccb-8e5a-a06cb67559c8" status: 200 len: 194 microversion: 2.1 time: 0.088603 Feb 17 04:48:38.330647 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 545/1091] 10.222.0.38 () {58 vars in 1403 bytes} [Wed Feb 17 04:48:38 2021] GET /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69/os-volume_attachments/6c5ff71e-6c61-4ccb-8e5a-a06cb67559c8 => generated 194 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:48:39.882750 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-f8fb5174-8ab2-490b-90d3-0930d43beb9f tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f707ad18-a3e7-4983-a536-fb7adeb25714"}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:48:39.883936 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-f8fb5174-8ab2-490b-90d3-0930d43beb9f tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: d62edd91-1355-4cb6-875b-86f12f404a69] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:48:39.892380 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f8fb5174-8ab2-490b-90d3-0930d43beb9f tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:39.892860 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f8fb5174-8ab2-490b-90d3-0930d43beb9f tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:39.893699 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f8fb5174-8ab2-490b-90d3-0930d43beb9f tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:39.894192 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f8fb5174-8ab2-490b-90d3-0930d43beb9f tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:40.255579 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-f8fb5174-8ab2-490b-90d3-0930d43beb9f tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "POST /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.376624 Feb 17 04:48:40.256219 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 547/1092] 10.222.0.38 () {60 vars in 1313 bytes} [Wed Feb 17 04:48:39 2021] POST /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69/os-volume_attachments => generated 194 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:48:48.089988 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-da837a5f-eb9b-4709-8506-f4b07371ad97 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:48:48.091405 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-da837a5f-eb9b-4709-8506-f4b07371ad97 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: d62edd91-1355-4cb6-875b-86f12f404a69] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:48:48.099787 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-da837a5f-eb9b-4709-8506-f4b07371ad97 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:48.100302 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-da837a5f-eb9b-4709-8506-f4b07371ad97 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:48.101146 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-da837a5f-eb9b-4709-8506-f4b07371ad97 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:48.101648 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-da837a5f-eb9b-4709-8506-f4b07371ad97 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:48.170666 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-da837a5f-eb9b-4709-8506-f4b07371ad97 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "GET /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.084982 Feb 17 04:48:48.171283 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 546/1093] 10.222.0.38 () {58 vars in 1292 bytes} [Wed Feb 17 04:48:48 2021] GET /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69/os-volume_attachments => generated 371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:48:48.406514 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-be7a59dc-7088-4ab6-ae58-3f1b39ff5439 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:48:48.407189 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-be7a59dc-7088-4ab6-ae58-3f1b39ff5439 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: d62edd91-1355-4cb6-875b-86f12f404a69] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:48:48.415945 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-be7a59dc-7088-4ab6-ae58-3f1b39ff5439 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:48.416460 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-be7a59dc-7088-4ab6-ae58-3f1b39ff5439 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:48.417312 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-be7a59dc-7088-4ab6-ae58-3f1b39ff5439 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:48.417813 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-be7a59dc-7088-4ab6-ae58-3f1b39ff5439 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:48.488383 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-be7a59dc-7088-4ab6-ae58-3f1b39ff5439 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "GET /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69/os-volume_attachments/6c5ff71e-6c61-4ccb-8e5a-a06cb67559c8" status: 200 len: 194 microversion: 2.1 time: 0.088166 Feb 17 04:48:48.489027 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 548/1094] 10.222.0.38 () {58 vars in 1403 bytes} [Wed Feb 17 04:48:48 2021] GET /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69/os-volume_attachments/6c5ff71e-6c61-4ccb-8e5a-a06cb67559c8 => generated 194 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:48:48.500037 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-d5bbd21b-f367-43ed-8c8d-6476e06f50f4 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:48:48.500609 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-d5bbd21b-f367-43ed-8c8d-6476e06f50f4 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: d62edd91-1355-4cb6-875b-86f12f404a69] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:48:48.508398 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d5bbd21b-f367-43ed-8c8d-6476e06f50f4 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:48.508901 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d5bbd21b-f367-43ed-8c8d-6476e06f50f4 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:48.509732 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d5bbd21b-f367-43ed-8c8d-6476e06f50f4 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:48.510224 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d5bbd21b-f367-43ed-8c8d-6476e06f50f4 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:48.685393 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.objects.instance [None req-d5bbd21b-f367-43ed-8c8d-6476e06f50f4 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lazy-loading 'services' on Instance uuid d62edd91-1355-4cb6-875b-86f12f404a69 {{(pid=98080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:48:48.825900 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-d5bbd21b-f367-43ed-8c8d-6476e06f50f4 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "DELETE /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69/os-volume_attachments/6c5ff71e-6c61-4ccb-8e5a-a06cb67559c8" status: 202 len: 0 microversion: 2.1 time: 0.330222 Feb 17 04:48:48.826659 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 547/1095] 10.222.0.38 () {58 vars in 1406 bytes} [Wed Feb 17 04:48:48 2021] DELETE /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69/os-volume_attachments/6c5ff71e-6c61-4ccb-8e5a-a06cb67559c8 => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:48:50.039649 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-8502e7bc-cc87-4593-a986-2e46a9c80d4c tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:48:50.040200 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-8502e7bc-cc87-4593-a986-2e46a9c80d4c tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: d62edd91-1355-4cb6-875b-86f12f404a69] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:48:50.049017 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8502e7bc-cc87-4593-a986-2e46a9c80d4c tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:50.049532 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8502e7bc-cc87-4593-a986-2e46a9c80d4c tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:50.050368 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8502e7bc-cc87-4593-a986-2e46a9c80d4c tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:50.050895 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-8502e7bc-cc87-4593-a986-2e46a9c80d4c tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:50.119709 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-8502e7bc-cc87-4593-a986-2e46a9c80d4c tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "GET /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69/os-volume_attachments/f707ad18-a3e7-4983-a536-fb7adeb25714" status: 200 len: 194 microversion: 2.1 time: 0.084132 Feb 17 04:48:50.120361 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 549/1096] 10.222.0.38 () {58 vars in 1403 bytes} [Wed Feb 17 04:48:50 2021] GET /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69/os-volume_attachments/f707ad18-a3e7-4983-a536-fb7adeb25714 => generated 194 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:48:50.132204 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-a5ca90fb-d31b-41b1-bf06-c7cd55b9834b tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:48:50.132859 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-a5ca90fb-d31b-41b1-bf06-c7cd55b9834b tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: d62edd91-1355-4cb6-875b-86f12f404a69] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:48:50.141027 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a5ca90fb-d31b-41b1-bf06-c7cd55b9834b tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:50.141489 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a5ca90fb-d31b-41b1-bf06-c7cd55b9834b tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:50.142333 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a5ca90fb-d31b-41b1-bf06-c7cd55b9834b tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:50.142862 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a5ca90fb-d31b-41b1-bf06-c7cd55b9834b tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:50.316116 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.objects.instance [None req-a5ca90fb-d31b-41b1-bf06-c7cd55b9834b tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lazy-loading 'services' on Instance uuid d62edd91-1355-4cb6-875b-86f12f404a69 {{(pid=98080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:48:50.458048 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-a5ca90fb-d31b-41b1-bf06-c7cd55b9834b tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "DELETE /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69/os-volume_attachments/f707ad18-a3e7-4983-a536-fb7adeb25714" status: 202 len: 0 microversion: 2.1 time: 0.330079 Feb 17 04:48:50.458829 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 548/1097] 10.222.0.38 () {58 vars in 1406 bytes} [Wed Feb 17 04:48:50 2021] DELETE /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69/os-volume_attachments/f707ad18-a3e7-4983-a536-fb7adeb25714 => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:48:52.061520 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-5caacdcc-152b-4745-9ad0-84dc43fc05f4 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:48:52.062127 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-5caacdcc-152b-4745-9ad0-84dc43fc05f4 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: d62edd91-1355-4cb6-875b-86f12f404a69] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:48:52.070376 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5caacdcc-152b-4745-9ad0-84dc43fc05f4 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:52.070936 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5caacdcc-152b-4745-9ad0-84dc43fc05f4 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:52.071777 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5caacdcc-152b-4745-9ad0-84dc43fc05f4 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:52.072270 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5caacdcc-152b-4745-9ad0-84dc43fc05f4 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:52.137555 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-5caacdcc-152b-4745-9ad0-84dc43fc05f4 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: d62edd91-1355-4cb6-875b-86f12f404a69] Going to try to terminate instance {{(pid=98081) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 04:48:52.255059 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-5caacdcc-152b-4745-9ad0-84dc43fc05f4 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "DELETE /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69" status: 204 len: 0 microversion: 2.1 time: 0.198347 Feb 17 04:48:52.255841 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 550/1098] 10.222.0.38 () {58 vars in 1229 bytes} [Wed Feb 17 04:48:52 2021] DELETE /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 17 04:48:52.265544 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-ad9aa28e-18e4-4770-875d-d8ab8deca9f1 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:48:52.266319 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-ad9aa28e-18e4-4770-875d-d8ab8deca9f1 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: d62edd91-1355-4cb6-875b-86f12f404a69] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:48:52.274937 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ad9aa28e-18e4-4770-875d-d8ab8deca9f1 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:52.275451 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ad9aa28e-18e4-4770-875d-d8ab8deca9f1 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:52.276298 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ad9aa28e-18e4-4770-875d-d8ab8deca9f1 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:52.276798 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ad9aa28e-18e4-4770-875d-d8ab8deca9f1 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:52.487494 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-ad9aa28e-18e4-4770-875d-d8ab8deca9f1 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8b4cda0b044342ba470c32b33d0a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbfc8aedca448fab8273424e08aecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:48:52.496435 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-ad9aa28e-18e4-4770-875d-d8ab8deca9f1 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "GET /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69" status: 200 len: 1674 microversion: 2.1 time: 0.235860 Feb 17 04:48:52.497048 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 549/1099] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:48:52 2021] GET /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69 => generated 1674 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:48:53.515898 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-53eeafa9-41f9-4099-a904-bd68e1400c00 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:48:53.516708 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-53eeafa9-41f9-4099-a904-bd68e1400c00 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: d62edd91-1355-4cb6-875b-86f12f404a69] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:48:53.524498 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-53eeafa9-41f9-4099-a904-bd68e1400c00 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:53.525008 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-53eeafa9-41f9-4099-a904-bd68e1400c00 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:53.525837 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-53eeafa9-41f9-4099-a904-bd68e1400c00 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:53.526331 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-53eeafa9-41f9-4099-a904-bd68e1400c00 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:53.737824 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-53eeafa9-41f9-4099-a904-bd68e1400c00 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8b4cda0b044342ba470c32b33d0a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbfc8aedca448fab8273424e08aecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:48:53.746836 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-53eeafa9-41f9-4099-a904-bd68e1400c00 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "GET /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69" status: 200 len: 1674 microversion: 2.1 time: 0.235460 Feb 17 04:48:53.748043 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 551/1100] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:48:53 2021] GET /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69 => generated 1674 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:48:54.766341 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-0a04b420-9bf7-4127-8bbb-c709f98b5c97 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:48:54.767289 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-0a04b420-9bf7-4127-8bbb-c709f98b5c97 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: d62edd91-1355-4cb6-875b-86f12f404a69] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:48:54.775433 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0a04b420-9bf7-4127-8bbb-c709f98b5c97 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:54.775946 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0a04b420-9bf7-4127-8bbb-c709f98b5c97 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:54.776793 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0a04b420-9bf7-4127-8bbb-c709f98b5c97 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:54.777337 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0a04b420-9bf7-4127-8bbb-c709f98b5c97 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:54.959463 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-0a04b420-9bf7-4127-8bbb-c709f98b5c97 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8b4cda0b044342ba470c32b33d0a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbfc8aedca448fab8273424e08aecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:48:54.969322 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-0a04b420-9bf7-4127-8bbb-c709f98b5c97 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "GET /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69" status: 200 len: 1607 microversion: 2.1 time: 0.207722 Feb 17 04:48:54.970159 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 550/1101] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:48:54 2021] GET /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69 => generated 1607 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:48:55.793986 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [req-f48872c3-fa63-4cd1-b450-b86f9341232c req-57ff7bdf-48cb-422b-b40b-fb876e04c3ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d62edd91-1355-4cb6-875b-86f12f404a69", "name": "network-vif-deleted", "tag": "2ded8dbd-6518-4ac7-bad2-d6eb541e39c4"}]} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:48:55.796034 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:48:55.796034 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:48:55.805236 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-f48872c3-fa63-4cd1-b450-b86f9341232c req-57ff7bdf-48cb-422b-b40b-fb876e04c3ed service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:55.805746 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-f48872c3-fa63-4cd1-b450-b86f9341232c req-57ff7bdf-48cb-422b-b40b-fb876e04c3ed service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:55.825200 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.compute.server_external_events [req-f48872c3-fa63-4cd1-b450-b86f9341232c req-57ff7bdf-48cb-422b-b40b-fb876e04c3ed service nova] Creating event network-vif-deleted:2ded8dbd-6518-4ac7-bad2-d6eb541e39c4 for instance d62edd91-1355-4cb6-875b-86f12f404a69 on hv-cinder-76019 Feb 17 04:48:55.832864 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [req-f48872c3-fa63-4cd1-b450-b86f9341232c req-57ff7bdf-48cb-422b-b40b-fb876e04c3ed service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042420 Feb 17 04:48:55.833785 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 552/1102] 10.222.0.38 () {64 vars in 1308 bytes} [Wed Feb 17 04:48:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:48:55.990648 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-9dc667c6-0146-4783-9687-6bc85272a5c5 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:48:55.991328 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-9dc667c6-0146-4783-9687-6bc85272a5c5 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: d62edd91-1355-4cb6-875b-86f12f404a69] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:48:56.001556 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9dc667c6-0146-4783-9687-6bc85272a5c5 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:56.002071 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9dc667c6-0146-4783-9687-6bc85272a5c5 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:56.003025 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9dc667c6-0146-4783-9687-6bc85272a5c5 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:56.003527 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9dc667c6-0146-4783-9687-6bc85272a5c5 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:56.078440 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9dc667c6-0146-4783-9687-6bc85272a5c5 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:56.079017 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9dc667c6-0146-4783-9687-6bc85272a5c5 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:56.079529 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.objects.instance [None req-9dc667c6-0146-4783-9687-6bc85272a5c5 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lazy-loading 'fault' on Instance uuid d62edd91-1355-4cb6-875b-86f12f404a69 {{(pid=98080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:48:56.161982 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-9dc667c6-0146-4783-9687-6bc85272a5c5 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d8b4cda0b044342ba470c32b33d0a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbfc8aedca448fab8273424e08aecf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:48:56.172317 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-9dc667c6-0146-4783-9687-6bc85272a5c5 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "GET /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69" status: 200 len: 1328 microversion: 2.1 time: 0.188385 Feb 17 04:48:56.173663 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 551/1103] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:48:55 2021] GET /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69 => generated 1328 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:48:57.192165 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-f331d33a-23c9-4d85-be22-06254c638bbe tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:48:57.192945 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-f331d33a-23c9-4d85-be22-06254c638bbe tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: d62edd91-1355-4cb6-875b-86f12f404a69] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:48:57.201730 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f331d33a-23c9-4d85-be22-06254c638bbe tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:57.202246 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f331d33a-23c9-4d85-be22-06254c638bbe tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:57.203128 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f331d33a-23c9-4d85-be22-06254c638bbe tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:48:57.203628 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f331d33a-23c9-4d85-be22-06254c638bbe tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:48:57.257421 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.wsgi [None req-f331d33a-23c9-4d85-be22-06254c638bbe tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] HTTP exception thrown: Instance d62edd91-1355-4cb6-875b-86f12f404a69 could not be found. Feb 17 04:48:57.258097 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-f331d33a-23c9-4d85-be22-06254c638bbe tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Returning 404 to user: Instance d62edd91-1355-4cb6-875b-86f12f404a69 could not be found. {{(pid=98081) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:48:57.259070 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-f331d33a-23c9-4d85-be22-06254c638bbe tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "GET /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69" status: 404 len: 111 microversion: 2.1 time: 0.071991 Feb 17 04:48:57.259903 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 553/1104] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:48:57 2021] GET /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:48:57.269420 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-5450ea69-c34d-4abd-97a0-9a5df7e6b559 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Calling method '.version_select at 0x7fc2e96c9510>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:48:57.287955 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-5450ea69-c34d-4abd-97a0-9a5df7e6b559 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1174513517" status: 202 len: 0 microversion: 2.1 time: 0.022652 Feb 17 04:48:57.288875 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 552/1105] 10.222.0.38 () {58 vars in 1211 bytes} [Wed Feb 17 04:48:57 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1174513517 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:49:00.952085 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-d656df7e-e8a4-4037-a974-0142c2ea1f42 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:49:00.952706 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-d656df7e-e8a4-4037-a974-0142c2ea1f42 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: d62edd91-1355-4cb6-875b-86f12f404a69] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:49:00.960736 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d656df7e-e8a4-4037-a974-0142c2ea1f42 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:49:00.961246 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d656df7e-e8a4-4037-a974-0142c2ea1f42 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:49:00.962120 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d656df7e-e8a4-4037-a974-0142c2ea1f42 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:49:00.962651 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d656df7e-e8a4-4037-a974-0142c2ea1f42 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:49:01.015572 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.wsgi [None req-d656df7e-e8a4-4037-a974-0142c2ea1f42 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] HTTP exception thrown: Instance d62edd91-1355-4cb6-875b-86f12f404a69 could not be found. Feb 17 04:49:01.016240 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-d656df7e-e8a4-4037-a974-0142c2ea1f42 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Returning 404 to user: Instance d62edd91-1355-4cb6-875b-86f12f404a69 could not be found. {{(pid=98081) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:49:01.017117 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-d656df7e-e8a4-4037-a974-0142c2ea1f42 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "DELETE /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69" status: 404 len: 111 microversion: 2.1 time: 0.069878 Feb 17 04:49:01.017730 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 554/1106] 10.222.0.38 () {58 vars in 1229 bytes} [Wed Feb 17 04:49:00 2021] DELETE /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:49:01.026784 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-70e72ad0-bf0b-4fbe-9f19-4eba7fea0d1a tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:49:01.027449 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-70e72ad0-bf0b-4fbe-9f19-4eba7fea0d1a tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: d62edd91-1355-4cb6-875b-86f12f404a69] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:49:01.035825 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-70e72ad0-bf0b-4fbe-9f19-4eba7fea0d1a tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:49:01.036330 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-70e72ad0-bf0b-4fbe-9f19-4eba7fea0d1a tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:49:01.037158 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-70e72ad0-bf0b-4fbe-9f19-4eba7fea0d1a tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:49:01.037648 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-70e72ad0-bf0b-4fbe-9f19-4eba7fea0d1a tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:49:01.090201 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.wsgi [None req-70e72ad0-bf0b-4fbe-9f19-4eba7fea0d1a tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] HTTP exception thrown: Instance d62edd91-1355-4cb6-875b-86f12f404a69 could not be found. Feb 17 04:49:01.090973 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-70e72ad0-bf0b-4fbe-9f19-4eba7fea0d1a tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Returning 404 to user: Instance d62edd91-1355-4cb6-875b-86f12f404a69 could not be found. {{(pid=98080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:49:01.091870 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-70e72ad0-bf0b-4fbe-9f19-4eba7fea0d1a tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "GET /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69" status: 404 len: 111 microversion: 2.1 time: 0.069575 Feb 17 04:49:01.092460 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 553/1107] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:49:01 2021] GET /compute/v2.1/servers/d62edd91-1355-4cb6-875b-86f12f404a69 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:49:02.338844 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-86a72ba2-078e-471d-8508-32af7070fc32 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:49:02.339398 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-86a72ba2-078e-471d-8508-32af7070fc32 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: 486ab1d3-d971-40c2-aca6-4ce6ef472355] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:49:02.347462 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-86a72ba2-078e-471d-8508-32af7070fc32 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:49:02.347968 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-86a72ba2-078e-471d-8508-32af7070fc32 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:49:02.348797 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-86a72ba2-078e-471d-8508-32af7070fc32 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:49:02.349286 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-86a72ba2-078e-471d-8508-32af7070fc32 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:49:02.405617 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.wsgi [None req-86a72ba2-078e-471d-8508-32af7070fc32 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] HTTP exception thrown: Instance 486ab1d3-d971-40c2-aca6-4ce6ef472355 could not be found. Feb 17 04:49:02.406266 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-86a72ba2-078e-471d-8508-32af7070fc32 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Returning 404 to user: Instance 486ab1d3-d971-40c2-aca6-4ce6ef472355 could not be found. {{(pid=98081) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:49:02.407177 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-86a72ba2-078e-471d-8508-32af7070fc32 tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "DELETE /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355" status: 404 len: 111 microversion: 2.1 time: 0.072379 Feb 17 04:49:02.407773 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 555/1108] 10.222.0.38 () {58 vars in 1229 bytes} [Wed Feb 17 04:49:02 2021] DELETE /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:49:02.416321 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-35e3df0d-3f1e-4937-bb14-39f1ea67d4cd tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:49:02.416998 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-35e3df0d-3f1e-4937-bb14-39f1ea67d4cd tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] [instance: 486ab1d3-d971-40c2-aca6-4ce6ef472355] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:49:02.425307 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-35e3df0d-3f1e-4937-bb14-39f1ea67d4cd tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:49:02.425820 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-35e3df0d-3f1e-4937-bb14-39f1ea67d4cd tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:49:02.426680 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-35e3df0d-3f1e-4937-bb14-39f1ea67d4cd tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:49:02.427177 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-35e3df0d-3f1e-4937-bb14-39f1ea67d4cd tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:49:02.483368 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.wsgi [None req-35e3df0d-3f1e-4937-bb14-39f1ea67d4cd tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] HTTP exception thrown: Instance 486ab1d3-d971-40c2-aca6-4ce6ef472355 could not be found. Feb 17 04:49:02.484021 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-35e3df0d-3f1e-4937-bb14-39f1ea67d4cd tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] Returning 404 to user: Instance 486ab1d3-d971-40c2-aca6-4ce6ef472355 could not be found. {{(pid=98080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:49:02.484961 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-35e3df0d-3f1e-4937-bb14-39f1ea67d4cd tempest-AttachVolumeTestJSON-1859099990 tempest-AttachVolumeTestJSON-1859099990-project] 10.222.0.38 "GET /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355" status: 404 len: 111 microversion: 2.1 time: 0.072675 Feb 17 04:49:02.485557 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 554/1109] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:49:02 2021] GET /compute/v2.1/servers/486ab1d3-d971-40c2-aca6-4ce6ef472355 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:50:04.344584 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-0b3c3430-8638-47d0-8e15-f7fe505d330f tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:50:04.345253 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-0b3c3430-8638-47d0-8e15-f7fe505d330f tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] [instance: ed61fd7e-829e-4928-8dc9-4597d4d49aec] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:50:04.354058 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0b3c3430-8638-47d0-8e15-f7fe505d330f tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:50:04.354597 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0b3c3430-8638-47d0-8e15-f7fe505d330f tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:50:04.355468 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0b3c3430-8638-47d0-8e15-f7fe505d330f tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:50:04.355977 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0b3c3430-8638-47d0-8e15-f7fe505d330f tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:50:04.421046 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-0b3c3430-8638-47d0-8e15-f7fe505d330f tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] [instance: ed61fd7e-829e-4928-8dc9-4597d4d49aec] Going to try to terminate instance {{(pid=98081) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 04:50:04.555739 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-0b3c3430-8638-47d0-8e15-f7fe505d330f tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] 10.222.0.38 "DELETE /compute/v2.1/servers/ed61fd7e-829e-4928-8dc9-4597d4d49aec" status: 204 len: 0 microversion: 2.1 time: 0.215204 Feb 17 04:50:04.556377 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 556/1110] 10.222.0.38 () {58 vars in 1229 bytes} [Wed Feb 17 04:50:04 2021] DELETE /compute/v2.1/servers/ed61fd7e-829e-4928-8dc9-4597d4d49aec => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 17 04:50:04.569168 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-eb30a5b2-4f89-4b66-ac66-a99abab7e790 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:50:04.569843 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-eb30a5b2-4f89-4b66-ac66-a99abab7e790 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] [instance: ed61fd7e-829e-4928-8dc9-4597d4d49aec] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:50:04.578000 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-eb30a5b2-4f89-4b66-ac66-a99abab7e790 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:50:04.578514 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-eb30a5b2-4f89-4b66-ac66-a99abab7e790 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:50:04.579378 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-eb30a5b2-4f89-4b66-ac66-a99abab7e790 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:50:04.579871 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-eb30a5b2-4f89-4b66-ac66-a99abab7e790 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:50:04.856391 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-eb30a5b2-4f89-4b66-ac66-a99abab7e790 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f25433642c4ea1996f8b1da7bf21d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cb524e7a8d4981b00474e1d9ed2062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:50:04.866682 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-eb30a5b2-4f89-4b66-ac66-a99abab7e790 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] 10.222.0.38 "GET /compute/v2.1/servers/ed61fd7e-829e-4928-8dc9-4597d4d49aec" status: 200 len: 1584 microversion: 2.1 time: 0.302788 Feb 17 04:50:04.867288 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 555/1111] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:50:04 2021] GET /compute/v2.1/servers/ed61fd7e-829e-4928-8dc9-4597d4d49aec => generated 1584 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:50:05.886194 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-6414bdd1-9b31-4e97-82e4-09a10a957e20 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:50:05.887016 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-6414bdd1-9b31-4e97-82e4-09a10a957e20 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] [instance: ed61fd7e-829e-4928-8dc9-4597d4d49aec] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:50:05.896028 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6414bdd1-9b31-4e97-82e4-09a10a957e20 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:50:05.896555 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6414bdd1-9b31-4e97-82e4-09a10a957e20 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:50:05.897392 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6414bdd1-9b31-4e97-82e4-09a10a957e20 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:50:05.897908 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6414bdd1-9b31-4e97-82e4-09a10a957e20 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:50:06.223810 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-6414bdd1-9b31-4e97-82e4-09a10a957e20 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f25433642c4ea1996f8b1da7bf21d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cb524e7a8d4981b00474e1d9ed2062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:50:06.240214 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-6414bdd1-9b31-4e97-82e4-09a10a957e20 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] 10.222.0.38 "GET /compute/v2.1/servers/ed61fd7e-829e-4928-8dc9-4597d4d49aec" status: 200 len: 1584 microversion: 2.1 time: 0.358700 Feb 17 04:50:06.240839 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 557/1112] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:50:05 2021] GET /compute/v2.1/servers/ed61fd7e-829e-4928-8dc9-4597d4d49aec => generated 1584 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:50:07.259385 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-69fee856-a34b-4f53-bf0b-52da06ac9a37 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:50:07.260062 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-69fee856-a34b-4f53-bf0b-52da06ac9a37 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] [instance: ed61fd7e-829e-4928-8dc9-4597d4d49aec] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:50:07.268166 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-69fee856-a34b-4f53-bf0b-52da06ac9a37 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:50:07.269094 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-69fee856-a34b-4f53-bf0b-52da06ac9a37 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:50:07.269677 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-69fee856-a34b-4f53-bf0b-52da06ac9a37 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:50:07.270070 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-69fee856-a34b-4f53-bf0b-52da06ac9a37 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:50:07.535007 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-69fee856-a34b-4f53-bf0b-52da06ac9a37 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f25433642c4ea1996f8b1da7bf21d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cb524e7a8d4981b00474e1d9ed2062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:50:07.544431 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-69fee856-a34b-4f53-bf0b-52da06ac9a37 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] 10.222.0.38 "GET /compute/v2.1/servers/ed61fd7e-829e-4928-8dc9-4597d4d49aec" status: 200 len: 1509 microversion: 2.1 time: 0.289038 Feb 17 04:50:07.545084 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 556/1113] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:50:07 2021] GET /compute/v2.1/servers/ed61fd7e-829e-4928-8dc9-4597d4d49aec => generated 1509 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:50:07.871658 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [req-27f4a31d-1ed8-4679-af8b-bf0ab032e878 req-0b4acd3c-2ebe-4232-9fa9-6929fc4be10c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed61fd7e-829e-4928-8dc9-4597d4d49aec", "name": "network-vif-deleted", "tag": "d7b71187-da26-482f-8eed-c8aacdbbf7ab"}]} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:50:07.873543 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:50:07.873543 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:50:07.883094 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-27f4a31d-1ed8-4679-af8b-bf0ab032e878 req-0b4acd3c-2ebe-4232-9fa9-6929fc4be10c service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:50:07.883611 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-27f4a31d-1ed8-4679-af8b-bf0ab032e878 req-0b4acd3c-2ebe-4232-9fa9-6929fc4be10c service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:50:07.914060 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.compute.server_external_events [req-27f4a31d-1ed8-4679-af8b-bf0ab032e878 req-0b4acd3c-2ebe-4232-9fa9-6929fc4be10c service nova] Creating event network-vif-deleted:d7b71187-da26-482f-8eed-c8aacdbbf7ab for instance ed61fd7e-829e-4928-8dc9-4597d4d49aec on hv-cinder-76019 Feb 17 04:50:07.921405 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [req-27f4a31d-1ed8-4679-af8b-bf0ab032e878 req-0b4acd3c-2ebe-4232-9fa9-6929fc4be10c service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053634 Feb 17 04:50:07.922073 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 558/1114] 10.222.0.38 () {64 vars in 1308 bytes} [Wed Feb 17 04:50:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:50:08.564151 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-ed75fd2f-c65f-4415-b485-ad5f7406a613 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:50:08.564728 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-ed75fd2f-c65f-4415-b485-ad5f7406a613 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] [instance: ed61fd7e-829e-4928-8dc9-4597d4d49aec] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:50:08.572946 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ed75fd2f-c65f-4415-b485-ad5f7406a613 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:50:08.573461 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ed75fd2f-c65f-4415-b485-ad5f7406a613 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:50:08.574355 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ed75fd2f-c65f-4415-b485-ad5f7406a613 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:50:08.574917 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ed75fd2f-c65f-4415-b485-ad5f7406a613 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:50:08.653839 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ed75fd2f-c65f-4415-b485-ad5f7406a613 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:50:08.654333 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ed75fd2f-c65f-4415-b485-ad5f7406a613 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:50:08.654878 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.objects.instance [None req-ed75fd2f-c65f-4415-b485-ad5f7406a613 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lazy-loading 'fault' on Instance uuid ed61fd7e-829e-4928-8dc9-4597d4d49aec {{(pid=98080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 04:50:08.775463 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-ed75fd2f-c65f-4415-b485-ad5f7406a613 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f25433642c4ea1996f8b1da7bf21d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cb524e7a8d4981b00474e1d9ed2062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:50:08.789470 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-ed75fd2f-c65f-4415-b485-ad5f7406a613 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] 10.222.0.38 "GET /compute/v2.1/servers/ed61fd7e-829e-4928-8dc9-4597d4d49aec" status: 200 len: 1231 microversion: 2.1 time: 0.229140 Feb 17 04:50:08.791156 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 557/1115] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:50:08 2021] GET /compute/v2.1/servers/ed61fd7e-829e-4928-8dc9-4597d4d49aec => generated 1231 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:50:09.813660 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-7e2b43e1-8a62-4713-9c09-f95a4d435393 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:50:09.814350 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-7e2b43e1-8a62-4713-9c09-f95a4d435393 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] [instance: ed61fd7e-829e-4928-8dc9-4597d4d49aec] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:50:09.829294 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7e2b43e1-8a62-4713-9c09-f95a4d435393 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:50:09.830241 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7e2b43e1-8a62-4713-9c09-f95a4d435393 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:50:09.832129 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7e2b43e1-8a62-4713-9c09-f95a4d435393 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:50:09.832913 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7e2b43e1-8a62-4713-9c09-f95a4d435393 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:50:09.915189 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.wsgi [None req-7e2b43e1-8a62-4713-9c09-f95a4d435393 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] HTTP exception thrown: Instance ed61fd7e-829e-4928-8dc9-4597d4d49aec could not be found. Feb 17 04:50:09.915869 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-7e2b43e1-8a62-4713-9c09-f95a4d435393 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Returning 404 to user: Instance ed61fd7e-829e-4928-8dc9-4597d4d49aec could not be found. {{(pid=98081) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:50:09.916789 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-7e2b43e1-8a62-4713-9c09-f95a4d435393 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] 10.222.0.38 "GET /compute/v2.1/servers/ed61fd7e-829e-4928-8dc9-4597d4d49aec" status: 404 len: 111 microversion: 2.1 time: 0.108021 Feb 17 04:50:09.917410 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 559/1116] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:50:09 2021] GET /compute/v2.1/servers/ed61fd7e-829e-4928-8dc9-4597d4d49aec => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:50:10.045774 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-d370de35-3020-40d7-a5bb-108bd2ad3ddf tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2060612294", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2057480649", "security_groups": [{"name": "tempest-TestVolumeBootPattern-1134504179"}], "block_device_mapping_v2": [{"uuid": "57e4bdb6-5172-45e1-95c2-4b11ef95e6b3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a877ef56-9526-4e88-a555-4c4a4c974334"}]}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:50:10.226491 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.network.neutron [None req-d370de35-3020-40d7-a5bb-108bd2ad3ddf tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] validate_networks() for [('a877ef56-9526-4e88-a555-4c4a4c974334', None, None, None)] {{(pid=98080) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 04:50:11.059228 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-d370de35-3020-40d7-a5bb-108bd2ad3ddf tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Flavor limits 0:0:0 {{(pid=98080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 04:50:11.059894 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-d370de35-3020-40d7-a5bb-108bd2ad3ddf tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Image limits 0:0:0 {{(pid=98080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 04:50:11.060550 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-d370de35-3020-40d7-a5bb-108bd2ad3ddf tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Flavor pref 0:0:0 {{(pid=98080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 04:50:11.061289 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-d370de35-3020-40d7-a5bb-108bd2ad3ddf tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Image pref 0:0:0 {{(pid=98080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 04:50:11.061809 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-d370de35-3020-40d7-a5bb-108bd2ad3ddf tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 04:50:11.071422 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d370de35-3020-40d7-a5bb-108bd2ad3ddf tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:50:11.071932 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d370de35-3020-40d7-a5bb-108bd2ad3ddf tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:50:11.072807 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d370de35-3020-40d7-a5bb-108bd2ad3ddf tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:50:11.073307 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d370de35-3020-40d7-a5bb-108bd2ad3ddf tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:50:11.091713 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.quota [None req-d370de35-3020-40d7-a5bb-108bd2ad3ddf tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Getting quotas for project 01cb524e7a8d4981b00474e1d9ed2062. Resources: {'instances', 'cores', 'ram'} {{(pid=98080) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:50:11.096112 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.quota [None req-d370de35-3020-40d7-a5bb-108bd2ad3ddf tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Getting quotas for user 75f25433642c4ea1996f8b1da7bf21d4 and project 01cb524e7a8d4981b00474e1d9ed2062. Resources: {'instances', 'cores', 'ram'} {{(pid=98080) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:50:11.219438 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-d370de35-3020-40d7-a5bb-108bd2ad3ddf tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Going to run 1 instances... {{(pid=98080) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 04:50:11.222581 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-d370de35-3020-40d7-a5bb-108bd2ad3ddf tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] [instance: 28c06dc3-0b56-4809-9026-1eaf9480095b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='57e4bdb6-5172-45e1-95c2-4b11ef95e6b3',volume_size=None,volume_type=None)] {{(pid=98080) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 04:50:11.428299 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-d370de35-3020-40d7-a5bb-108bd2ad3ddf tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] 10.222.0.38 "POST /compute/v2.1/servers" status: 202 len: 413 microversion: 2.1 time: 1.386328 Feb 17 04:50:11.429167 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 558/1117] 10.222.0.38 () {60 vars in 1137 bytes} [Wed Feb 17 04:50:10 2021] POST /compute/v2.1/servers => generated 413 bytes in 1388 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 17 04:50:11.442922 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-2a6b72ca-2f2e-45f5-9fe7-18e8933b23bc tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:50:11.443599 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-2a6b72ca-2f2e-45f5-9fe7-18e8933b23bc tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] [instance: 28c06dc3-0b56-4809-9026-1eaf9480095b] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:50:11.544619 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-2a6b72ca-2f2e-45f5-9fe7-18e8933b23bc tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f25433642c4ea1996f8b1da7bf21d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cb524e7a8d4981b00474e1d9ed2062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:50:11.562175 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-2a6b72ca-2f2e-45f5-9fe7-18e8933b23bc tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] 10.222.0.38 "GET /compute/v2.1/servers/28c06dc3-0b56-4809-9026-1eaf9480095b" status: 200 len: 1095 microversion: 2.1 time: 0.124644 Feb 17 04:50:11.563419 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 560/1118] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:50:11 2021] GET /compute/v2.1/servers/28c06dc3-0b56-4809-9026-1eaf9480095b => generated 1095 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:50:12.598190 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-e08d5d42-a46a-41a9-b34e-115af1bff55e tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:50:12.598979 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-e08d5d42-a46a-41a9-b34e-115af1bff55e tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] [instance: 28c06dc3-0b56-4809-9026-1eaf9480095b] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:50:12.607692 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e08d5d42-a46a-41a9-b34e-115af1bff55e tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:50:12.608212 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e08d5d42-a46a-41a9-b34e-115af1bff55e tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:50:12.609069 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e08d5d42-a46a-41a9-b34e-115af1bff55e tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:50:12.609568 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e08d5d42-a46a-41a9-b34e-115af1bff55e tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:50:12.752699 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-e08d5d42-a46a-41a9-b34e-115af1bff55e tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f25433642c4ea1996f8b1da7bf21d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cb524e7a8d4981b00474e1d9ed2062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:50:12.762186 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-e08d5d42-a46a-41a9-b34e-115af1bff55e tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] 10.222.0.38 "GET /compute/v2.1/servers/28c06dc3-0b56-4809-9026-1eaf9480095b" status: 200 len: 1211 microversion: 2.1 time: 0.179700 Feb 17 04:50:12.763012 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 559/1119] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:50:12 2021] GET /compute/v2.1/servers/28c06dc3-0b56-4809-9026-1eaf9480095b => generated 1211 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:50:13.780740 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-bcc10579-02fe-4b22-b196-4a1d157c6954 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:50:13.781532 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-bcc10579-02fe-4b22-b196-4a1d157c6954 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] [instance: 28c06dc3-0b56-4809-9026-1eaf9480095b] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:50:13.792174 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-bcc10579-02fe-4b22-b196-4a1d157c6954 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:50:13.792695 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-bcc10579-02fe-4b22-b196-4a1d157c6954 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:50:13.793552 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-bcc10579-02fe-4b22-b196-4a1d157c6954 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:50:13.794053 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-bcc10579-02fe-4b22-b196-4a1d157c6954 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:50:14.137193 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-bcc10579-02fe-4b22-b196-4a1d157c6954 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f25433642c4ea1996f8b1da7bf21d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cb524e7a8d4981b00474e1d9ed2062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:50:14.147178 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-bcc10579-02fe-4b22-b196-4a1d157c6954 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] 10.222.0.38 "GET /compute/v2.1/servers/28c06dc3-0b56-4809-9026-1eaf9480095b" status: 200 len: 1274 microversion: 2.1 time: 0.370480 Feb 17 04:50:14.148032 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 561/1120] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:50:13 2021] GET /compute/v2.1/servers/28c06dc3-0b56-4809-9026-1eaf9480095b => generated 1274 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:50:15.167078 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-e35eb869-a75b-43d1-83cf-8987bc102268 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:50:15.167754 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-e35eb869-a75b-43d1-83cf-8987bc102268 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] [instance: 28c06dc3-0b56-4809-9026-1eaf9480095b] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:50:15.176283 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e35eb869-a75b-43d1-83cf-8987bc102268 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:50:15.176791 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e35eb869-a75b-43d1-83cf-8987bc102268 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:50:15.177641 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e35eb869-a75b-43d1-83cf-8987bc102268 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:50:15.178138 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e35eb869-a75b-43d1-83cf-8987bc102268 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:50:15.578744 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [req-de74e6ba-6a16-417e-a87a-7655773b4bfe req-2b3f15b5-a862-4084-83b4-f2c8ae5253b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28c06dc3-0b56-4809-9026-1eaf9480095b", "tag": "aaba6df2-825a-4e72-abaf-91c6289d2624"}]} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:50:15.581202 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:50:15.581202 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:50:15.591526 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-de74e6ba-6a16-417e-a87a-7655773b4bfe req-2b3f15b5-a862-4084-83b4-f2c8ae5253b6 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:50:15.592293 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-de74e6ba-6a16-417e-a87a-7655773b4bfe req-2b3f15b5-a862-4084-83b4-f2c8ae5253b6 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:50:15.613099 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.compute.server_external_events [req-de74e6ba-6a16-417e-a87a-7655773b4bfe req-2b3f15b5-a862-4084-83b4-f2c8ae5253b6 service nova] Creating event network-changed:aaba6df2-825a-4e72-abaf-91c6289d2624 for instance 28c06dc3-0b56-4809-9026-1eaf9480095b on hv-cinder-76019 Feb 17 04:50:15.619061 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [req-de74e6ba-6a16-417e-a87a-7655773b4bfe req-2b3f15b5-a862-4084-83b4-f2c8ae5253b6 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045650 Feb 17 04:50:15.620080 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 562/1121] 10.222.0.38 () {64 vars in 1308 bytes} [Wed Feb 17 04:50:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:50:15.707210 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-e35eb869-a75b-43d1-83cf-8987bc102268 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f25433642c4ea1996f8b1da7bf21d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cb524e7a8d4981b00474e1d9ed2062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:50:15.716198 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-e35eb869-a75b-43d1-83cf-8987bc102268 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] 10.222.0.38 "GET /compute/v2.1/servers/28c06dc3-0b56-4809-9026-1eaf9480095b" status: 200 len: 1274 microversion: 2.1 time: 0.553387 Feb 17 04:50:15.716846 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 560/1122] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:50:15 2021] GET /compute/v2.1/servers/28c06dc3-0b56-4809-9026-1eaf9480095b => generated 1274 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:50:16.737254 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-a5c4b47b-2a39-4ef8-8d1f-7c118d957c16 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:50:16.738106 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-a5c4b47b-2a39-4ef8-8d1f-7c118d957c16 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] [instance: 28c06dc3-0b56-4809-9026-1eaf9480095b] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:50:16.746254 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a5c4b47b-2a39-4ef8-8d1f-7c118d957c16 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:50:16.746800 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a5c4b47b-2a39-4ef8-8d1f-7c118d957c16 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:50:16.747644 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a5c4b47b-2a39-4ef8-8d1f-7c118d957c16 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:50:16.748135 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-a5c4b47b-2a39-4ef8-8d1f-7c118d957c16 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:50:17.163288 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-a5c4b47b-2a39-4ef8-8d1f-7c118d957c16 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f25433642c4ea1996f8b1da7bf21d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cb524e7a8d4981b00474e1d9ed2062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:50:17.172476 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-a5c4b47b-2a39-4ef8-8d1f-7c118d957c16 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] 10.222.0.38 "GET /compute/v2.1/servers/28c06dc3-0b56-4809-9026-1eaf9480095b" status: 200 len: 1274 microversion: 2.1 time: 0.440662 Feb 17 04:50:17.173415 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 563/1123] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:50:16 2021] GET /compute/v2.1/servers/28c06dc3-0b56-4809-9026-1eaf9480095b => generated 1274 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:50:18.198444 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-ae83c3b4-ec4e-4f6a-9599-fd53eb17e261 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:50:18.199183 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-ae83c3b4-ec4e-4f6a-9599-fd53eb17e261 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] [instance: 28c06dc3-0b56-4809-9026-1eaf9480095b] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:50:18.208205 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ae83c3b4-ec4e-4f6a-9599-fd53eb17e261 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:50:18.208719 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ae83c3b4-ec4e-4f6a-9599-fd53eb17e261 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:50:18.209556 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ae83c3b4-ec4e-4f6a-9599-fd53eb17e261 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:50:18.210052 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ae83c3b4-ec4e-4f6a-9599-fd53eb17e261 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:50:18.437047 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-ae83c3b4-ec4e-4f6a-9599-fd53eb17e261 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f25433642c4ea1996f8b1da7bf21d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cb524e7a8d4981b00474e1d9ed2062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:50:18.446940 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-ae83c3b4-ec4e-4f6a-9599-fd53eb17e261 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] 10.222.0.38 "GET /compute/v2.1/servers/28c06dc3-0b56-4809-9026-1eaf9480095b" status: 200 len: 1274 microversion: 2.1 time: 0.252578 Feb 17 04:50:18.447551 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 561/1124] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:50:18 2021] GET /compute/v2.1/servers/28c06dc3-0b56-4809-9026-1eaf9480095b => generated 1274 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:50:19.465595 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-bf8b95d6-6094-49f5-82f8-3ccd63b5d587 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:50:19.466973 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-bf8b95d6-6094-49f5-82f8-3ccd63b5d587 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] [instance: 28c06dc3-0b56-4809-9026-1eaf9480095b] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:50:19.475660 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-bf8b95d6-6094-49f5-82f8-3ccd63b5d587 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:50:19.476179 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-bf8b95d6-6094-49f5-82f8-3ccd63b5d587 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:50:19.477030 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-bf8b95d6-6094-49f5-82f8-3ccd63b5d587 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:50:19.477527 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-bf8b95d6-6094-49f5-82f8-3ccd63b5d587 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:50:19.745771 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-bf8b95d6-6094-49f5-82f8-3ccd63b5d587 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f25433642c4ea1996f8b1da7bf21d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cb524e7a8d4981b00474e1d9ed2062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:50:19.755921 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-bf8b95d6-6094-49f5-82f8-3ccd63b5d587 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] 10.222.0.38 "GET /compute/v2.1/servers/28c06dc3-0b56-4809-9026-1eaf9480095b" status: 200 len: 1274 microversion: 2.1 time: 0.294313 Feb 17 04:50:19.756548 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 564/1125] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:50:19 2021] GET /compute/v2.1/servers/28c06dc3-0b56-4809-9026-1eaf9480095b => generated 1274 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:50:20.773683 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-3fd35510-9cbf-424c-a036-62ac3b0d1f20 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:50:20.774349 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-3fd35510-9cbf-424c-a036-62ac3b0d1f20 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] [instance: 28c06dc3-0b56-4809-9026-1eaf9480095b] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:50:20.782262 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-3fd35510-9cbf-424c-a036-62ac3b0d1f20 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:50:20.782812 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-3fd35510-9cbf-424c-a036-62ac3b0d1f20 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:50:20.784156 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-3fd35510-9cbf-424c-a036-62ac3b0d1f20 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:50:20.784649 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-3fd35510-9cbf-424c-a036-62ac3b0d1f20 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:50:20.999248 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-3fd35510-9cbf-424c-a036-62ac3b0d1f20 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f25433642c4ea1996f8b1da7bf21d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cb524e7a8d4981b00474e1d9ed2062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:50:21.008842 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-3fd35510-9cbf-424c-a036-62ac3b0d1f20 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] 10.222.0.38 "GET /compute/v2.1/servers/28c06dc3-0b56-4809-9026-1eaf9480095b" status: 200 len: 1274 microversion: 2.1 time: 0.239119 Feb 17 04:50:21.009461 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 562/1126] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:50:20 2021] GET /compute/v2.1/servers/28c06dc3-0b56-4809-9026-1eaf9480095b => generated 1274 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:50:22.027484 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-aed49d1b-47dc-4eae-af8a-79c276f56b87 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:50:22.028166 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-aed49d1b-47dc-4eae-af8a-79c276f56b87 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] [instance: 28c06dc3-0b56-4809-9026-1eaf9480095b] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:50:22.036542 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-aed49d1b-47dc-4eae-af8a-79c276f56b87 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:50:22.037064 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-aed49d1b-47dc-4eae-af8a-79c276f56b87 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:50:22.037922 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-aed49d1b-47dc-4eae-af8a-79c276f56b87 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:50:22.038427 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-aed49d1b-47dc-4eae-af8a-79c276f56b87 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:50:22.266244 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-aed49d1b-47dc-4eae-af8a-79c276f56b87 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f25433642c4ea1996f8b1da7bf21d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cb524e7a8d4981b00474e1d9ed2062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:50:22.275291 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-aed49d1b-47dc-4eae-af8a-79c276f56b87 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] 10.222.0.38 "GET /compute/v2.1/servers/28c06dc3-0b56-4809-9026-1eaf9480095b" status: 200 len: 1274 microversion: 2.1 time: 0.252331 Feb 17 04:50:22.275900 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 565/1127] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:50:22 2021] GET /compute/v2.1/servers/28c06dc3-0b56-4809-9026-1eaf9480095b => generated 1274 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:50:23.294714 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-9bc2a536-d548-42af-924b-f21324d10250 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:50:23.295382 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-9bc2a536-d548-42af-924b-f21324d10250 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] [instance: 28c06dc3-0b56-4809-9026-1eaf9480095b] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:50:23.303270 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9bc2a536-d548-42af-924b-f21324d10250 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:50:23.303779 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9bc2a536-d548-42af-924b-f21324d10250 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:50:23.304613 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9bc2a536-d548-42af-924b-f21324d10250 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:50:23.305103 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-9bc2a536-d548-42af-924b-f21324d10250 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:50:23.513602 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-9bc2a536-d548-42af-924b-f21324d10250 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f25433642c4ea1996f8b1da7bf21d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cb524e7a8d4981b00474e1d9ed2062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:50:23.522420 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-9bc2a536-d548-42af-924b-f21324d10250 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] 10.222.0.38 "GET /compute/v2.1/servers/28c06dc3-0b56-4809-9026-1eaf9480095b" status: 200 len: 1274 microversion: 2.1 time: 0.231692 Feb 17 04:50:23.523132 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 563/1128] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:50:23 2021] GET /compute/v2.1/servers/28c06dc3-0b56-4809-9026-1eaf9480095b => generated 1274 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:50:24.252600 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [req-03fb6fef-78de-4bb5-82cc-db825223ca27 req-7f54d33f-14c1-447c-a119-95837a4734c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28c06dc3-0b56-4809-9026-1eaf9480095b", "name": "network-vif-plugged", "status": "completed", "tag": "aaba6df2-825a-4e72-abaf-91c6289d2624"}]} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:50:24.255174 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:50:24.255174 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:50:24.267223 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-03fb6fef-78de-4bb5-82cc-db825223ca27 req-7f54d33f-14c1-447c-a119-95837a4734c0 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:50:24.267789 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-03fb6fef-78de-4bb5-82cc-db825223ca27 req-7f54d33f-14c1-447c-a119-95837a4734c0 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:50:24.286120 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.compute.server_external_events [req-03fb6fef-78de-4bb5-82cc-db825223ca27 req-7f54d33f-14c1-447c-a119-95837a4734c0 service nova] Creating event network-vif-plugged:aaba6df2-825a-4e72-abaf-91c6289d2624 for instance 28c06dc3-0b56-4809-9026-1eaf9480095b on hv-cinder-76019 Feb 17 04:50:24.291502 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [req-03fb6fef-78de-4bb5-82cc-db825223ca27 req-7f54d33f-14c1-447c-a119-95837a4734c0 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043789 Feb 17 04:50:24.292161 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 566/1129] 10.222.0.38 () {64 vars in 1308 bytes} [Wed Feb 17 04:50:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:50:24.540955 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-f96ded04-bf11-4fcf-a39d-b2503f2eab2d tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:50:24.541540 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-f96ded04-bf11-4fcf-a39d-b2503f2eab2d tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] [instance: 28c06dc3-0b56-4809-9026-1eaf9480095b] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:50:24.550039 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f96ded04-bf11-4fcf-a39d-b2503f2eab2d tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:50:24.550542 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f96ded04-bf11-4fcf-a39d-b2503f2eab2d tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:50:24.551416 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f96ded04-bf11-4fcf-a39d-b2503f2eab2d tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:50:24.551905 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-f96ded04-bf11-4fcf-a39d-b2503f2eab2d tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:50:24.781781 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-f96ded04-bf11-4fcf-a39d-b2503f2eab2d tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f25433642c4ea1996f8b1da7bf21d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cb524e7a8d4981b00474e1d9ed2062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:50:24.791275 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-f96ded04-bf11-4fcf-a39d-b2503f2eab2d tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] 10.222.0.38 "GET /compute/v2.1/servers/28c06dc3-0b56-4809-9026-1eaf9480095b" status: 200 len: 1274 microversion: 2.1 time: 0.254337 Feb 17 04:50:24.791813 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 564/1130] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:50:24 2021] GET /compute/v2.1/servers/28c06dc3-0b56-4809-9026-1eaf9480095b => generated 1274 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:50:25.810692 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-4fa23da7-494d-489d-be68-05b1cb1df3bd tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:50:25.811480 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-4fa23da7-494d-489d-be68-05b1cb1df3bd tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] [instance: 28c06dc3-0b56-4809-9026-1eaf9480095b] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:50:25.821624 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4fa23da7-494d-489d-be68-05b1cb1df3bd tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:50:25.822139 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4fa23da7-494d-489d-be68-05b1cb1df3bd tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:50:25.823024 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4fa23da7-494d-489d-be68-05b1cb1df3bd tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:50:25.823559 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4fa23da7-494d-489d-be68-05b1cb1df3bd tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:50:26.042804 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-4fa23da7-494d-489d-be68-05b1cb1df3bd tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f25433642c4ea1996f8b1da7bf21d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cb524e7a8d4981b00474e1d9ed2062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:50:26.052478 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-4fa23da7-494d-489d-be68-05b1cb1df3bd tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] 10.222.0.38 "GET /compute/v2.1/servers/28c06dc3-0b56-4809-9026-1eaf9480095b" status: 200 len: 1461 microversion: 2.1 time: 0.246619 Feb 17 04:50:26.053098 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 567/1131] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:50:25 2021] GET /compute/v2.1/servers/28c06dc3-0b56-4809-9026-1eaf9480095b => generated 1461 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:50:26.071179 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-c3151053-0ce3-4bc1-8985-cb9488537f6c tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:50:26.071846 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-c3151053-0ce3-4bc1-8985-cb9488537f6c tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] [instance: 28c06dc3-0b56-4809-9026-1eaf9480095b] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:50:26.079692 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c3151053-0ce3-4bc1-8985-cb9488537f6c tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:50:26.080256 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c3151053-0ce3-4bc1-8985-cb9488537f6c tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:50:26.081044 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c3151053-0ce3-4bc1-8985-cb9488537f6c tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:50:26.081535 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-c3151053-0ce3-4bc1-8985-cb9488537f6c tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:50:26.307821 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-c3151053-0ce3-4bc1-8985-cb9488537f6c tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f25433642c4ea1996f8b1da7bf21d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cb524e7a8d4981b00474e1d9ed2062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:50:26.317248 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-c3151053-0ce3-4bc1-8985-cb9488537f6c tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] 10.222.0.38 "GET /compute/v2.1/servers/28c06dc3-0b56-4809-9026-1eaf9480095b" status: 200 len: 1461 microversion: 2.1 time: 0.250474 Feb 17 04:50:26.317856 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 565/1132] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:50:26 2021] GET /compute/v2.1/servers/28c06dc3-0b56-4809-9026-1eaf9480095b => generated 1461 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:50:26.334960 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-8a334941-3a08-4f98-a70e-7579c04a59a0 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Action: 'create', calling method: .version_select at 0x7fc2e9d27950>, body: {"pool": null} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:50:29.641309 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-8a334941-3a08-4f98-a70e-7579c04a59a0 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] 10.222.0.38 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.310369 Feb 17 04:50:29.642004 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 568/1133] 10.222.0.38 () {60 vars in 1160 bytes} [Wed Feb 17 04:50:26 2021] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:50:29.654137 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-e27007bf-45a0-444c-ba35-4a65a0373f42 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.27.0.71"}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:50:29.655495 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-e27007bf-45a0-444c-ba35-4a65a0373f42 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] [instance: 28c06dc3-0b56-4809-9026-1eaf9480095b] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:50:29.664552 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e27007bf-45a0-444c-ba35-4a65a0373f42 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:50:29.665069 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e27007bf-45a0-444c-ba35-4a65a0373f42 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:50:29.665922 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e27007bf-45a0-444c-ba35-4a65a0373f42 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:50:29.666421 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e27007bf-45a0-444c-ba35-4a65a0373f42 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:50:29.733641 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e27007bf-45a0-444c-ba35-4a65a0373f42 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Acquired lock "refresh_cache-28c06dc3-0b56-4809-9026-1eaf9480095b" {{(pid=98080) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Feb 17 04:50:31.799165 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.network.neutron [None req-e27007bf-45a0-444c-ba35-4a65a0373f42 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] [instance: 28c06dc3-0b56-4809-9026-1eaf9480095b] Building network info cache for instance {{(pid=98080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1836}} Feb 17 04:50:31.809982 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [req-68e5986a-fa5e-4ff8-ad06-f4826d455e50 req-b42f5a02-7e3f-4057-9023-9ac8334c2630 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28c06dc3-0b56-4809-9026-1eaf9480095b", "tag": "aaba6df2-825a-4e72-abaf-91c6289d2624"}]} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:50:31.811779 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:50:31.811779 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:50:31.822411 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-68e5986a-fa5e-4ff8-ad06-f4826d455e50 req-b42f5a02-7e3f-4057-9023-9ac8334c2630 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:50:31.823008 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-68e5986a-fa5e-4ff8-ad06-f4826d455e50 req-b42f5a02-7e3f-4057-9023-9ac8334c2630 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:50:31.841666 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.compute.server_external_events [req-68e5986a-fa5e-4ff8-ad06-f4826d455e50 req-b42f5a02-7e3f-4057-9023-9ac8334c2630 service nova] Creating event network-changed:aaba6df2-825a-4e72-abaf-91c6289d2624 for instance 28c06dc3-0b56-4809-9026-1eaf9480095b on hv-cinder-76019 Feb 17 04:50:31.848304 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [req-68e5986a-fa5e-4ff8-ad06-f4826d455e50 req-b42f5a02-7e3f-4057-9023-9ac8334c2630 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041473 Feb 17 04:50:31.849252 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 569/1134] 10.222.0.38 () {64 vars in 1308 bytes} [Wed Feb 17 04:50:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:50:33.337077 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.network.neutron [None req-e27007bf-45a0-444c-ba35-4a65a0373f42 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] [instance: 28c06dc3-0b56-4809-9026-1eaf9480095b] Updating instance_info_cache with network_info: [{"id": "aaba6df2-825a-4e72-abaf-91c6289d2624", "address": "fa:16:3e:12:66:1f", "network": {"id": "a877ef56-9526-4e88-a555-4c4a4c974334", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-239973466-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.27.0.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "01cb524e7a8d4981b00474e1d9ed2062", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tapaaba6df2-82", "ovs_interfaceid": "aaba6df2-825a-4e72-abaf-91c6289d2624", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=98080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Feb 17 04:50:33.348423 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e27007bf-45a0-444c-ba35-4a65a0373f42 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Releasing lock "refresh_cache-28c06dc3-0b56-4809-9026-1eaf9480095b" {{(pid=98080) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Feb 17 04:50:33.349681 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-e27007bf-45a0-444c-ba35-4a65a0373f42 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] 10.222.0.38 "POST /compute/v2.1/servers/28c06dc3-0b56-4809-9026-1eaf9480095b/action" status: 202 len: 0 microversion: 2.1 time: 3.699735 Feb 17 04:50:33.363300 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 566/1135] 10.222.0.38 () {60 vars in 1268 bytes} [Wed Feb 17 04:50:29 2021] POST /compute/v2.1/servers/28c06dc3-0b56-4809-9026-1eaf9480095b/action => generated 0 bytes in 3714 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Feb 17 04:50:52.034385 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 17 04:50:52.034929 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: Wed Feb 17 04:50:52 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 17 04:51:52.095539 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 17 04:51:52.096078 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: Wed Feb 17 04:51:52 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 17 04:52:18.437320 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-465997fd-36eb-4ce6-85a4-1647d2d22097 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1280440271", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2057480649", "security_groups": [{"name": "tempest-TestVolumeBootPattern-1134504179"}], "block_device_mapping_v2": [{"uuid": "daca23e6-456c-40b4-83d9-8102802cca22", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a877ef56-9526-4e88-a555-4c4a4c974334"}]}} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:52:18.851385 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.network.neutron [None req-465997fd-36eb-4ce6-85a4-1647d2d22097 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] validate_networks() for [('a877ef56-9526-4e88-a555-4c4a4c974334', None, None, None)] {{(pid=98081) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 04:52:19.424473 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-465997fd-36eb-4ce6-85a4-1647d2d22097 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Flavor limits 0:0:0 {{(pid=98081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 04:52:19.424952 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-465997fd-36eb-4ce6-85a4-1647d2d22097 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Image limits 0:0:0 {{(pid=98081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 04:52:19.425501 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-465997fd-36eb-4ce6-85a4-1647d2d22097 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Flavor pref 0:0:0 {{(pid=98081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 04:52:19.425968 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-465997fd-36eb-4ce6-85a4-1647d2d22097 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Image pref 0:0:0 {{(pid=98081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 04:52:19.426477 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.virt.hardware [None req-465997fd-36eb-4ce6-85a4-1647d2d22097 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98081) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 04:52:19.435686 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-465997fd-36eb-4ce6-85a4-1647d2d22097 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:52:19.436202 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-465997fd-36eb-4ce6-85a4-1647d2d22097 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:52:19.437075 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-465997fd-36eb-4ce6-85a4-1647d2d22097 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:52:19.437576 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-465997fd-36eb-4ce6-85a4-1647d2d22097 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:52:19.456459 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.quota [None req-465997fd-36eb-4ce6-85a4-1647d2d22097 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Getting quotas for project 01cb524e7a8d4981b00474e1d9ed2062. Resources: {'instances', 'cores', 'ram'} {{(pid=98081) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 04:52:19.461303 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.quota [None req-465997fd-36eb-4ce6-85a4-1647d2d22097 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Getting quotas for user 75f25433642c4ea1996f8b1da7bf21d4 and project 01cb524e7a8d4981b00474e1d9ed2062. Resources: {'instances', 'cores', 'ram'} {{(pid=98081) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 04:52:19.571714 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-465997fd-36eb-4ce6-85a4-1647d2d22097 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Going to run 1 instances... {{(pid=98081) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 04:52:19.574228 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-465997fd-36eb-4ce6-85a4-1647d2d22097 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] [instance: 58e29ec6-b1ea-4572-8a8d-2e3ac599b7fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='daca23e6-456c-40b4-83d9-8102802cca22',volume_size=None,volume_type=None)] {{(pid=98081) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 04:52:19.743985 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: ERROR oslo.messaging._drivers.impl_rabbit [None req-465997fd-36eb-4ce6-85a4-1647d2d22097 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] [cc3d8000-5bf0-4e2d-a672-26c95c600476] AMQP server on 10.222.0.38:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Feb 17 04:52:20.760822 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO oslo.messaging._drivers.impl_rabbit [None req-465997fd-36eb-4ce6-85a4-1647d2d22097 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] [cc3d8000-5bf0-4e2d-a672-26c95c600476] Reconnected to AMQP server on 10.222.0.38:5672 via [amqp] client with port 58364. Feb 17 04:52:20.764828 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-465997fd-36eb-4ce6-85a4-1647d2d22097 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] 10.222.0.38 "POST /compute/v2.1/servers" status: 202 len: 413 microversion: 2.1 time: 2.332879 Feb 17 04:52:20.765531 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 570/1136] 10.222.0.38 () {60 vars in 1137 bytes} [Wed Feb 17 04:52:18 2021] POST /compute/v2.1/servers => generated 413 bytes in 2334 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 17 04:52:20.777009 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-d6eb3110-be5f-4845-bceb-81b870acfd0a tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:52:20.777682 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-d6eb3110-be5f-4845-bceb-81b870acfd0a tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] [instance: 58e29ec6-b1ea-4572-8a8d-2e3ac599b7fc] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:52:20.979040 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-d6eb3110-be5f-4845-bceb-81b870acfd0a tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f25433642c4ea1996f8b1da7bf21d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cb524e7a8d4981b00474e1d9ed2062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:52:20.987250 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-d6eb3110-be5f-4845-bceb-81b870acfd0a tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] 10.222.0.38 "GET /compute/v2.1/servers/58e29ec6-b1ea-4572-8a8d-2e3ac599b7fc" status: 200 len: 1095 microversion: 2.1 time: 0.214372 Feb 17 04:52:20.987827 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 567/1137] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:52:20 2021] GET /compute/v2.1/servers/58e29ec6-b1ea-4572-8a8d-2e3ac599b7fc => generated 1095 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:52:22.006357 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-84d7efec-699c-429f-9c59-ec0ad90c592d tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:52:22.007676 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-84d7efec-699c-429f-9c59-ec0ad90c592d tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] [instance: 58e29ec6-b1ea-4572-8a8d-2e3ac599b7fc] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:52:22.020923 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-84d7efec-699c-429f-9c59-ec0ad90c592d tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:52:22.021453 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-84d7efec-699c-429f-9c59-ec0ad90c592d tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:52:22.022323 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-84d7efec-699c-429f-9c59-ec0ad90c592d tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:52:22.022863 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-84d7efec-699c-429f-9c59-ec0ad90c592d tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:52:22.170146 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-84d7efec-699c-429f-9c59-ec0ad90c592d tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f25433642c4ea1996f8b1da7bf21d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cb524e7a8d4981b00474e1d9ed2062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:52:22.179999 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-84d7efec-699c-429f-9c59-ec0ad90c592d tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] 10.222.0.38 "GET /compute/v2.1/servers/58e29ec6-b1ea-4572-8a8d-2e3ac599b7fc" status: 200 len: 1211 microversion: 2.1 time: 0.178393 Feb 17 04:52:22.180663 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 571/1138] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:52:22 2021] GET /compute/v2.1/servers/58e29ec6-b1ea-4572-8a8d-2e3ac599b7fc => generated 1211 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:52:23.199259 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-65422a2d-487d-4937-b6d5-c4d45eb3b95d tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:52:23.200042 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-65422a2d-487d-4937-b6d5-c4d45eb3b95d tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] [instance: 58e29ec6-b1ea-4572-8a8d-2e3ac599b7fc] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:52:23.213063 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-65422a2d-487d-4937-b6d5-c4d45eb3b95d tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:52:23.213662 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-65422a2d-487d-4937-b6d5-c4d45eb3b95d tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:52:23.214671 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-65422a2d-487d-4937-b6d5-c4d45eb3b95d tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:52:23.215178 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-65422a2d-487d-4937-b6d5-c4d45eb3b95d tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:52:23.666808 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-65422a2d-487d-4937-b6d5-c4d45eb3b95d tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f25433642c4ea1996f8b1da7bf21d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cb524e7a8d4981b00474e1d9ed2062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:52:23.675667 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-65422a2d-487d-4937-b6d5-c4d45eb3b95d tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] 10.222.0.38 "GET /compute/v2.1/servers/58e29ec6-b1ea-4572-8a8d-2e3ac599b7fc" status: 200 len: 1274 microversion: 2.1 time: 0.480409 Feb 17 04:52:23.676834 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 568/1139] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:52:23 2021] GET /compute/v2.1/servers/58e29ec6-b1ea-4572-8a8d-2e3ac599b7fc => generated 1274 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:52:24.630644 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [req-3d9001fc-a218-44cf-90fe-b66bba9d7053 req-2c23f939-6d6c-4aca-90bf-66e2a0d411a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58e29ec6-b1ea-4572-8a8d-2e3ac599b7fc", "tag": "94a0a043-61c1-452f-8790-f62c52b0bb57"}]} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:52:24.633124 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:52:24.633124 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:52:24.642361 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-3d9001fc-a218-44cf-90fe-b66bba9d7053 req-2c23f939-6d6c-4aca-90bf-66e2a0d411a4 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:52:24.643070 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-3d9001fc-a218-44cf-90fe-b66bba9d7053 req-2c23f939-6d6c-4aca-90bf-66e2a0d411a4 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:52:24.662010 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.compute.server_external_events [req-3d9001fc-a218-44cf-90fe-b66bba9d7053 req-2c23f939-6d6c-4aca-90bf-66e2a0d411a4 service nova] Creating event network-changed:94a0a043-61c1-452f-8790-f62c52b0bb57 for instance 58e29ec6-b1ea-4572-8a8d-2e3ac599b7fc on hv-cinder-76019 Feb 17 04:52:24.667886 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [req-3d9001fc-a218-44cf-90fe-b66bba9d7053 req-2c23f939-6d6c-4aca-90bf-66e2a0d411a4 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105177 Feb 17 04:52:24.668772 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 572/1140] 10.222.0.38 () {64 vars in 1308 bytes} [Wed Feb 17 04:52:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:52:24.695379 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-bed66c80-e3c4-4ffb-9d37-90e682966495 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:52:24.696183 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-bed66c80-e3c4-4ffb-9d37-90e682966495 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] [instance: 58e29ec6-b1ea-4572-8a8d-2e3ac599b7fc] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:52:24.704754 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-bed66c80-e3c4-4ffb-9d37-90e682966495 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:52:24.705343 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-bed66c80-e3c4-4ffb-9d37-90e682966495 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:52:24.706462 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-bed66c80-e3c4-4ffb-9d37-90e682966495 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:52:24.707069 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-bed66c80-e3c4-4ffb-9d37-90e682966495 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:52:25.252455 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-bed66c80-e3c4-4ffb-9d37-90e682966495 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f25433642c4ea1996f8b1da7bf21d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cb524e7a8d4981b00474e1d9ed2062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:52:25.261990 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-bed66c80-e3c4-4ffb-9d37-90e682966495 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] 10.222.0.38 "GET /compute/v2.1/servers/58e29ec6-b1ea-4572-8a8d-2e3ac599b7fc" status: 200 len: 1274 microversion: 2.1 time: 0.571235 Feb 17 04:52:25.262606 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 569/1141] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:52:24 2021] GET /compute/v2.1/servers/58e29ec6-b1ea-4572-8a8d-2e3ac599b7fc => generated 1274 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:52:26.281798 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-de690c11-79ba-4a7f-ba04-55415475c1f4 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:52:26.282643 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-de690c11-79ba-4a7f-ba04-55415475c1f4 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] [instance: 58e29ec6-b1ea-4572-8a8d-2e3ac599b7fc] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:52:26.286533 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4942cc57-7807-47b1-95da-4b2606610666] AMQP server on 10.222.0.38:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Feb 17 04:52:26.292051 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-de690c11-79ba-4a7f-ba04-55415475c1f4 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:52:26.292610 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-de690c11-79ba-4a7f-ba04-55415475c1f4 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:52:26.293454 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-de690c11-79ba-4a7f-ba04-55415475c1f4 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:52:26.293948 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-de690c11-79ba-4a7f-ba04-55415475c1f4 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:52:26.523011 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-de690c11-79ba-4a7f-ba04-55415475c1f4 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f25433642c4ea1996f8b1da7bf21d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cb524e7a8d4981b00474e1d9ed2062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:52:26.531739 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-de690c11-79ba-4a7f-ba04-55415475c1f4 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] 10.222.0.38 "GET /compute/v2.1/servers/58e29ec6-b1ea-4572-8a8d-2e3ac599b7fc" status: 200 len: 1274 microversion: 2.1 time: 0.254601 Feb 17 04:52:26.532395 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 573/1142] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:52:26 2021] GET /compute/v2.1/servers/58e29ec6-b1ea-4572-8a8d-2e3ac599b7fc => generated 1274 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:52:27.550267 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-99e90155-f1bb-4afb-acfa-02177e22a087 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:52:27.550974 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-99e90155-f1bb-4afb-acfa-02177e22a087 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] [instance: 58e29ec6-b1ea-4572-8a8d-2e3ac599b7fc] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:52:27.558797 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-99e90155-f1bb-4afb-acfa-02177e22a087 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:52:27.559569 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-99e90155-f1bb-4afb-acfa-02177e22a087 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:52:27.560404 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-99e90155-f1bb-4afb-acfa-02177e22a087 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:52:27.560898 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-99e90155-f1bb-4afb-acfa-02177e22a087 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:52:27.776305 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-99e90155-f1bb-4afb-acfa-02177e22a087 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f25433642c4ea1996f8b1da7bf21d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cb524e7a8d4981b00474e1d9ed2062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:52:27.785088 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-99e90155-f1bb-4afb-acfa-02177e22a087 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] 10.222.0.38 "GET /compute/v2.1/servers/58e29ec6-b1ea-4572-8a8d-2e3ac599b7fc" status: 200 len: 1274 microversion: 2.1 time: 0.238924 Feb 17 04:52:27.785701 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 570/1143] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:52:27 2021] GET /compute/v2.1/servers/58e29ec6-b1ea-4572-8a8d-2e3ac599b7fc => generated 1274 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:52:28.803254 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-10b4276b-6b2b-46e6-9218-9d034eca0cbd tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:52:28.803926 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-10b4276b-6b2b-46e6-9218-9d034eca0cbd tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] [instance: 58e29ec6-b1ea-4572-8a8d-2e3ac599b7fc] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:52:28.822798 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-10b4276b-6b2b-46e6-9218-9d034eca0cbd tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:52:28.823310 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-10b4276b-6b2b-46e6-9218-9d034eca0cbd tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:52:28.824146 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-10b4276b-6b2b-46e6-9218-9d034eca0cbd tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:52:28.824642 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-10b4276b-6b2b-46e6-9218-9d034eca0cbd tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:52:28.861997 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO oslo.messaging._drivers.impl_rabbit [-] [4942cc57-7807-47b1-95da-4b2606610666] Reconnected to AMQP server on 10.222.0.38:5672 via [amqp] client with port 58396. Feb 17 04:52:29.041891 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-10b4276b-6b2b-46e6-9218-9d034eca0cbd tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f25433642c4ea1996f8b1da7bf21d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cb524e7a8d4981b00474e1d9ed2062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:52:29.050758 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-10b4276b-6b2b-46e6-9218-9d034eca0cbd tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] 10.222.0.38 "GET /compute/v2.1/servers/58e29ec6-b1ea-4572-8a8d-2e3ac599b7fc" status: 200 len: 1274 microversion: 2.1 time: 0.251733 Feb 17 04:52:29.051395 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 574/1144] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:52:28 2021] GET /compute/v2.1/servers/58e29ec6-b1ea-4572-8a8d-2e3ac599b7fc => generated 1274 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:52:30.069258 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-d19381d7-d48d-4a22-89da-3cd082befe05 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:52:30.069923 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-d19381d7-d48d-4a22-89da-3cd082befe05 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] [instance: 58e29ec6-b1ea-4572-8a8d-2e3ac599b7fc] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:52:30.077683 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d19381d7-d48d-4a22-89da-3cd082befe05 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:52:30.078188 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d19381d7-d48d-4a22-89da-3cd082befe05 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:52:30.079043 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d19381d7-d48d-4a22-89da-3cd082befe05 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:52:30.079530 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-d19381d7-d48d-4a22-89da-3cd082befe05 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:52:30.305849 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-d19381d7-d48d-4a22-89da-3cd082befe05 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f25433642c4ea1996f8b1da7bf21d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cb524e7a8d4981b00474e1d9ed2062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:52:30.314938 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-d19381d7-d48d-4a22-89da-3cd082befe05 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] 10.222.0.38 "GET /compute/v2.1/servers/58e29ec6-b1ea-4572-8a8d-2e3ac599b7fc" status: 200 len: 1274 microversion: 2.1 time: 0.249854 Feb 17 04:52:30.315538 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 571/1145] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:52:30 2021] GET /compute/v2.1/servers/58e29ec6-b1ea-4572-8a8d-2e3ac599b7fc => generated 1274 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:52:31.333547 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-cfb28a92-a03d-47d2-9818-cd7b9cc97477 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:52:31.334226 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-cfb28a92-a03d-47d2-9818-cd7b9cc97477 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] [instance: 58e29ec6-b1ea-4572-8a8d-2e3ac599b7fc] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:52:31.342042 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-cfb28a92-a03d-47d2-9818-cd7b9cc97477 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:52:31.342555 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-cfb28a92-a03d-47d2-9818-cd7b9cc97477 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:52:31.343438 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-cfb28a92-a03d-47d2-9818-cd7b9cc97477 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:52:31.343935 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-cfb28a92-a03d-47d2-9818-cd7b9cc97477 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:52:31.555807 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-cfb28a92-a03d-47d2-9818-cd7b9cc97477 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f25433642c4ea1996f8b1da7bf21d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cb524e7a8d4981b00474e1d9ed2062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:52:31.565053 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-cfb28a92-a03d-47d2-9818-cd7b9cc97477 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] 10.222.0.38 "GET /compute/v2.1/servers/58e29ec6-b1ea-4572-8a8d-2e3ac599b7fc" status: 200 len: 1274 microversion: 2.1 time: 0.236090 Feb 17 04:52:31.565652 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 575/1146] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:52:31 2021] GET /compute/v2.1/servers/58e29ec6-b1ea-4572-8a8d-2e3ac599b7fc => generated 1274 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:52:32.583595 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-e03f26e8-7f47-42a9-bc28-e497f06fde83 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:52:32.584375 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-e03f26e8-7f47-42a9-bc28-e497f06fde83 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] [instance: 58e29ec6-b1ea-4572-8a8d-2e3ac599b7fc] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:52:32.592181 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e03f26e8-7f47-42a9-bc28-e497f06fde83 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:52:32.592686 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e03f26e8-7f47-42a9-bc28-e497f06fde83 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:52:32.593513 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e03f26e8-7f47-42a9-bc28-e497f06fde83 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:52:32.594000 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-e03f26e8-7f47-42a9-bc28-e497f06fde83 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:52:32.808503 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-e03f26e8-7f47-42a9-bc28-e497f06fde83 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f25433642c4ea1996f8b1da7bf21d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cb524e7a8d4981b00474e1d9ed2062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:52:32.818065 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-e03f26e8-7f47-42a9-bc28-e497f06fde83 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] 10.222.0.38 "GET /compute/v2.1/servers/58e29ec6-b1ea-4572-8a8d-2e3ac599b7fc" status: 200 len: 1274 microversion: 2.1 time: 0.238586 Feb 17 04:52:32.818696 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 572/1147] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:52:32 2021] GET /compute/v2.1/servers/58e29ec6-b1ea-4572-8a8d-2e3ac599b7fc => generated 1274 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:52:33.100048 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [req-b739c711-8789-476d-8c95-3b3233d9edbc req-2040bfbd-cd51-484b-a206-87e08ecf3a03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58e29ec6-b1ea-4572-8a8d-2e3ac599b7fc", "name": "network-vif-plugged", "status": "completed", "tag": "94a0a043-61c1-452f-8790-f62c52b0bb57"}]} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:52:33.101712 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:52:33.101712 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:52:33.110422 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-b739c711-8789-476d-8c95-3b3233d9edbc req-2040bfbd-cd51-484b-a206-87e08ecf3a03 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:52:33.110969 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-b739c711-8789-476d-8c95-3b3233d9edbc req-2040bfbd-cd51-484b-a206-87e08ecf3a03 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:52:33.128358 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.compute.server_external_events [req-b739c711-8789-476d-8c95-3b3233d9edbc req-2040bfbd-cd51-484b-a206-87e08ecf3a03 service nova] Creating event network-vif-plugged:94a0a043-61c1-452f-8790-f62c52b0bb57 for instance 58e29ec6-b1ea-4572-8a8d-2e3ac599b7fc on hv-cinder-76019 Feb 17 04:52:33.133560 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [req-b739c711-8789-476d-8c95-3b3233d9edbc req-2040bfbd-cd51-484b-a206-87e08ecf3a03 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096880 Feb 17 04:52:33.134128 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 576/1148] 10.222.0.38 () {64 vars in 1308 bytes} [Wed Feb 17 04:52:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:52:33.836933 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-6d4d7b96-ec7b-4ea2-808f-051cafe6615c tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:52:33.837602 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-6d4d7b96-ec7b-4ea2-808f-051cafe6615c tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] [instance: 58e29ec6-b1ea-4572-8a8d-2e3ac599b7fc] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:52:33.845381 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6d4d7b96-ec7b-4ea2-808f-051cafe6615c tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:52:33.845885 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6d4d7b96-ec7b-4ea2-808f-051cafe6615c tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:52:33.846832 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6d4d7b96-ec7b-4ea2-808f-051cafe6615c tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:52:33.847325 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6d4d7b96-ec7b-4ea2-808f-051cafe6615c tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:52:34.057624 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-6d4d7b96-ec7b-4ea2-808f-051cafe6615c tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f25433642c4ea1996f8b1da7bf21d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cb524e7a8d4981b00474e1d9ed2062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:52:34.066715 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-6d4d7b96-ec7b-4ea2-808f-051cafe6615c tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] 10.222.0.38 "GET /compute/v2.1/servers/58e29ec6-b1ea-4572-8a8d-2e3ac599b7fc" status: 200 len: 1274 microversion: 2.1 time: 0.233875 Feb 17 04:52:34.067453 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 573/1149] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:52:33 2021] GET /compute/v2.1/servers/58e29ec6-b1ea-4572-8a8d-2e3ac599b7fc => generated 1274 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:52:35.085318 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-92a99ef7-c78b-45e1-8040-6ae543b07cd7 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:52:35.086153 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-92a99ef7-c78b-45e1-8040-6ae543b07cd7 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] [instance: 58e29ec6-b1ea-4572-8a8d-2e3ac599b7fc] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:52:35.095465 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-92a99ef7-c78b-45e1-8040-6ae543b07cd7 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:52:35.095985 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-92a99ef7-c78b-45e1-8040-6ae543b07cd7 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:52:35.096842 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-92a99ef7-c78b-45e1-8040-6ae543b07cd7 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:52:35.097340 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-92a99ef7-c78b-45e1-8040-6ae543b07cd7 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:52:35.402381 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-92a99ef7-c78b-45e1-8040-6ae543b07cd7 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f25433642c4ea1996f8b1da7bf21d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cb524e7a8d4981b00474e1d9ed2062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:52:35.412388 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-92a99ef7-c78b-45e1-8040-6ae543b07cd7 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] 10.222.0.38 "GET /compute/v2.1/servers/58e29ec6-b1ea-4572-8a8d-2e3ac599b7fc" status: 200 len: 1460 microversion: 2.1 time: 0.332240 Feb 17 04:52:35.412999 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 577/1150] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:52:35 2021] GET /compute/v2.1/servers/58e29ec6-b1ea-4572-8a8d-2e3ac599b7fc => generated 1460 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:52:35.433457 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-3666d80e-d84a-4bf7-ad1a-4f0ea135d889 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:52:35.434387 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-3666d80e-d84a-4bf7-ad1a-4f0ea135d889 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] [instance: 58e29ec6-b1ea-4572-8a8d-2e3ac599b7fc] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:52:35.445759 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-3666d80e-d84a-4bf7-ad1a-4f0ea135d889 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:52:35.446261 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-3666d80e-d84a-4bf7-ad1a-4f0ea135d889 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:52:35.447143 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-3666d80e-d84a-4bf7-ad1a-4f0ea135d889 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:52:35.447642 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-3666d80e-d84a-4bf7-ad1a-4f0ea135d889 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:52:35.688190 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-3666d80e-d84a-4bf7-ad1a-4f0ea135d889 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f25433642c4ea1996f8b1da7bf21d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cb524e7a8d4981b00474e1d9ed2062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:52:35.697928 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-3666d80e-d84a-4bf7-ad1a-4f0ea135d889 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] 10.222.0.38 "GET /compute/v2.1/servers/58e29ec6-b1ea-4572-8a8d-2e3ac599b7fc" status: 200 len: 1460 microversion: 2.1 time: 0.269163 Feb 17 04:52:35.698520 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 574/1151] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:52:35 2021] GET /compute/v2.1/servers/58e29ec6-b1ea-4572-8a8d-2e3ac599b7fc => generated 1460 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 04:52:35.716089 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-665462aa-bc84-4e84-8f84-350b261cf282 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Action: 'create', calling method: .version_select at 0x7fc2e9cebd08>, body: {"pool": null} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:52:37.953643 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-665462aa-bc84-4e84-8f84-350b261cf282 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] 10.222.0.38 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.241416 Feb 17 04:52:37.954270 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 578/1152] 10.222.0.38 () {60 vars in 1160 bytes} [Wed Feb 17 04:52:35 2021] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:52:37.965964 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-6c2338ba-8697-48a8-bf3f-57b4273328f0 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.27.0.35"}} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:52:37.967395 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-6c2338ba-8697-48a8-bf3f-57b4273328f0 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] [instance: 58e29ec6-b1ea-4572-8a8d-2e3ac599b7fc] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:52:37.976605 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6c2338ba-8697-48a8-bf3f-57b4273328f0 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:52:37.977116 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6c2338ba-8697-48a8-bf3f-57b4273328f0 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:52:37.977968 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6c2338ba-8697-48a8-bf3f-57b4273328f0 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:52:37.978455 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6c2338ba-8697-48a8-bf3f-57b4273328f0 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:52:38.044541 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6c2338ba-8697-48a8-bf3f-57b4273328f0 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Acquired lock "refresh_cache-58e29ec6-b1ea-4572-8a8d-2e3ac599b7fc" {{(pid=98080) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Feb 17 04:52:39.763664 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.network.neutron [None req-6c2338ba-8697-48a8-bf3f-57b4273328f0 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] [instance: 58e29ec6-b1ea-4572-8a8d-2e3ac599b7fc] Building network info cache for instance {{(pid=98080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1836}} Feb 17 04:52:39.772441 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [req-b72d7f07-bbcc-48d0-a5a1-51ff849793a8 req-bd16fd62-6dbd-4c70-ae0e-d5bee906c09d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58e29ec6-b1ea-4572-8a8d-2e3ac599b7fc", "tag": "94a0a043-61c1-452f-8790-f62c52b0bb57"}]} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:52:39.774165 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:52:39.774165 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:52:39.783795 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-b72d7f07-bbcc-48d0-a5a1-51ff849793a8 req-bd16fd62-6dbd-4c70-ae0e-d5bee906c09d service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:52:39.784478 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-b72d7f07-bbcc-48d0-a5a1-51ff849793a8 req-bd16fd62-6dbd-4c70-ae0e-d5bee906c09d service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:52:39.803113 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.compute.server_external_events [req-b72d7f07-bbcc-48d0-a5a1-51ff849793a8 req-bd16fd62-6dbd-4c70-ae0e-d5bee906c09d service nova] Creating event network-changed:94a0a043-61c1-452f-8790-f62c52b0bb57 for instance 58e29ec6-b1ea-4572-8a8d-2e3ac599b7fc on hv-cinder-76019 Feb 17 04:52:39.808304 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [req-b72d7f07-bbcc-48d0-a5a1-51ff849793a8 req-bd16fd62-6dbd-4c70-ae0e-d5bee906c09d service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040033 Feb 17 04:52:39.809421 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 579/1153] 10.222.0.38 () {64 vars in 1308 bytes} [Wed Feb 17 04:52:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:52:41.567720 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.network.neutron [None req-6c2338ba-8697-48a8-bf3f-57b4273328f0 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] [instance: 58e29ec6-b1ea-4572-8a8d-2e3ac599b7fc] Updating instance_info_cache with network_info: [{"id": "94a0a043-61c1-452f-8790-f62c52b0bb57", "address": "fa:16:3e:fc:b7:ce", "network": {"id": "a877ef56-9526-4e88-a555-4c4a4c974334", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-239973466-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.27.0.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "01cb524e7a8d4981b00474e1d9ed2062", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tap94a0a043-61", "ovs_interfaceid": "94a0a043-61c1-452f-8790-f62c52b0bb57", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=98080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Feb 17 04:52:41.578330 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6c2338ba-8697-48a8-bf3f-57b4273328f0 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Releasing lock "refresh_cache-58e29ec6-b1ea-4572-8a8d-2e3ac599b7fc" {{(pid=98080) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Feb 17 04:52:41.579288 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-6c2338ba-8697-48a8-bf3f-57b4273328f0 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] 10.222.0.38 "POST /compute/v2.1/servers/58e29ec6-b1ea-4572-8a8d-2e3ac599b7fc/action" status: 202 len: 0 microversion: 2.1 time: 3.617465 Feb 17 04:52:41.579936 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 575/1154] 10.222.0.38 () {60 vars in 1268 bytes} [Wed Feb 17 04:52:37 2021] POST /compute/v2.1/servers/58e29ec6-b1ea-4572-8a8d-2e3ac599b7fc/action => generated 0 bytes in 3619 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Feb 17 04:53:06.100864 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 17 04:53:06.101438 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: Wed Feb 17 04:53:06 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 17 04:54:07.897948 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-6137e091-3209-464a-9a72-b52b8002873c tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Calling method '.version_select at 0x7fc2e9ceb268>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:54:08.666793 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-6137e091-3209-464a-9a72-b52b8002873c tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] [instance: 58e29ec6-b1ea-4572-8a8d-2e3ac599b7fc] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:54:08.675552 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6137e091-3209-464a-9a72-b52b8002873c tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:54:08.676077 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6137e091-3209-464a-9a72-b52b8002873c tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:54:08.677635 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6137e091-3209-464a-9a72-b52b8002873c tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:54:08.678185 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6137e091-3209-464a-9a72-b52b8002873c tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:54:08.744365 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6137e091-3209-464a-9a72-b52b8002873c tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Acquired lock "refresh_cache-58e29ec6-b1ea-4572-8a8d-2e3ac599b7fc" {{(pid=98081) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Feb 17 04:54:10.573383 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.network.neutron [None req-6137e091-3209-464a-9a72-b52b8002873c tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] [instance: 58e29ec6-b1ea-4572-8a8d-2e3ac599b7fc] Building network info cache for instance {{(pid=98081) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1836}} Feb 17 04:54:10.579929 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d56bda35-d649-490d-b41f-a3e70f815aaa] AMQP server on 10.222.0.38:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Feb 17 04:54:10.583823 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [req-952aa81d-432a-4fa1-ac27-67b46a2d3f3f req-253caf8c-1779-49f5-a8aa-600747037188 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58e29ec6-b1ea-4572-8a8d-2e3ac599b7fc", "tag": "94a0a043-61c1-452f-8790-f62c52b0bb57"}]} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:54:10.585544 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:54:10.585544 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:54:10.595017 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-952aa81d-432a-4fa1-ac27-67b46a2d3f3f req-253caf8c-1779-49f5-a8aa-600747037188 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:54:10.595540 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-952aa81d-432a-4fa1-ac27-67b46a2d3f3f req-253caf8c-1779-49f5-a8aa-600747037188 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:54:10.615287 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.compute.server_external_events [req-952aa81d-432a-4fa1-ac27-67b46a2d3f3f req-253caf8c-1779-49f5-a8aa-600747037188 service nova] Creating event network-changed:94a0a043-61c1-452f-8790-f62c52b0bb57 for instance 58e29ec6-b1ea-4572-8a8d-2e3ac599b7fc on hv-cinder-76019 Feb 17 04:54:10.622033 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [req-952aa81d-432a-4fa1-ac27-67b46a2d3f3f req-253caf8c-1779-49f5-a8aa-600747037188 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043122 Feb 17 04:54:10.623083 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 576/1155] 10.222.0.38 () {64 vars in 1308 bytes} [Wed Feb 17 04:54:10 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:54:12.054283 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 17 04:54:12.054898 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: Wed Feb 17 04:54:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-floating-ips/6a0663ad-ce04-49f2-9233-67f2ef79cad2 (ip 10.222.0.38) !!! Feb 17 04:54:12.301083 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.network.neutron [None req-6137e091-3209-464a-9a72-b52b8002873c tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] [instance: 58e29ec6-b1ea-4572-8a8d-2e3ac599b7fc] Updating instance_info_cache with network_info: [{"id": "94a0a043-61c1-452f-8790-f62c52b0bb57", "address": "fa:16:3e:fc:b7:ce", "network": {"id": "a877ef56-9526-4e88-a555-4c4a4c974334", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-239973466-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "01cb524e7a8d4981b00474e1d9ed2062", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tap94a0a043-61", "ovs_interfaceid": "94a0a043-61c1-452f-8790-f62c52b0bb57", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=98081) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Feb 17 04:54:12.311998 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-6137e091-3209-464a-9a72-b52b8002873c tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Releasing lock "refresh_cache-58e29ec6-b1ea-4572-8a8d-2e3ac599b7fc" {{(pid=98081) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Feb 17 04:54:12.312946 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-6137e091-3209-464a-9a72-b52b8002873c tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] 10.222.0.38 "DELETE /compute/v2.1/os-floating-ips/6a0663ad-ce04-49f2-9233-67f2ef79cad2" status: 202 len: 0 microversion: 2.1 time: 4.420870 Feb 17 04:54:12.313599 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 580/1156] 10.222.0.38 () {58 vars in 1253 bytes} [Wed Feb 17 04:54:07 2021] DELETE /compute/v2.1/os-floating-ips/6a0663ad-ce04-49f2-9233-67f2ef79cad2 => generated 0 bytes in 4422 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:54:12.323453 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-0ea98274-2fae-4212-9957-2602aeb470e6 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:54:12.324106 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-0ea98274-2fae-4212-9957-2602aeb470e6 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] [instance: 58e29ec6-b1ea-4572-8a8d-2e3ac599b7fc] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:54:12.343491 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0ea98274-2fae-4212-9957-2602aeb470e6 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:54:12.344007 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0ea98274-2fae-4212-9957-2602aeb470e6 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:54:12.344859 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0ea98274-2fae-4212-9957-2602aeb470e6 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:54:12.345352 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0ea98274-2fae-4212-9957-2602aeb470e6 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:54:12.405270 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO oslo.messaging._drivers.impl_rabbit [-] [d56bda35-d649-490d-b41f-a3e70f815aaa] Reconnected to AMQP server on 10.222.0.38:5672 via [amqp] client with port 58460. Feb 17 04:54:12.416275 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-0ea98274-2fae-4212-9957-2602aeb470e6 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] [instance: 58e29ec6-b1ea-4572-8a8d-2e3ac599b7fc] Going to try to terminate instance {{(pid=98080) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 04:54:12.675711 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-0ea98274-2fae-4212-9957-2602aeb470e6 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] 10.222.0.38 "DELETE /compute/v2.1/servers/58e29ec6-b1ea-4572-8a8d-2e3ac599b7fc" status: 204 len: 0 microversion: 2.1 time: 0.356343 Feb 17 04:54:12.677052 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 577/1157] 10.222.0.38 () {58 vars in 1229 bytes} [Wed Feb 17 04:54:12 2021] DELETE /compute/v2.1/servers/58e29ec6-b1ea-4572-8a8d-2e3ac599b7fc => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 17 04:54:12.687497 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-51c3dfde-e984-457f-8755-28b2539fadf0 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:54:12.688180 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-51c3dfde-e984-457f-8755-28b2539fadf0 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] [instance: 58e29ec6-b1ea-4572-8a8d-2e3ac599b7fc] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:54:12.696757 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-51c3dfde-e984-457f-8755-28b2539fadf0 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:54:12.697285 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-51c3dfde-e984-457f-8755-28b2539fadf0 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:54:12.698129 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-51c3dfde-e984-457f-8755-28b2539fadf0 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:54:12.698656 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-51c3dfde-e984-457f-8755-28b2539fadf0 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:54:12.927681 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-51c3dfde-e984-457f-8755-28b2539fadf0 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f25433642c4ea1996f8b1da7bf21d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cb524e7a8d4981b00474e1d9ed2062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:54:12.936940 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-51c3dfde-e984-457f-8755-28b2539fadf0 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] 10.222.0.38 "GET /compute/v2.1/servers/58e29ec6-b1ea-4572-8a8d-2e3ac599b7fc" status: 200 len: 1466 microversion: 2.1 time: 0.254563 Feb 17 04:54:12.937558 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 581/1158] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:54:12 2021] GET /compute/v2.1/servers/58e29ec6-b1ea-4572-8a8d-2e3ac599b7fc => generated 1466 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:54:13.960109 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-284c248a-823e-4fed-a9c6-1e87907035b3 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:54:13.960970 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-284c248a-823e-4fed-a9c6-1e87907035b3 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] [instance: 58e29ec6-b1ea-4572-8a8d-2e3ac599b7fc] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:54:13.969793 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-284c248a-823e-4fed-a9c6-1e87907035b3 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:54:13.970364 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-284c248a-823e-4fed-a9c6-1e87907035b3 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:54:13.971357 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-284c248a-823e-4fed-a9c6-1e87907035b3 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:54:13.971942 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-284c248a-823e-4fed-a9c6-1e87907035b3 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:54:14.198544 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-284c248a-823e-4fed-a9c6-1e87907035b3 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f25433642c4ea1996f8b1da7bf21d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cb524e7a8d4981b00474e1d9ed2062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:54:14.207924 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-284c248a-823e-4fed-a9c6-1e87907035b3 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] 10.222.0.38 "GET /compute/v2.1/servers/58e29ec6-b1ea-4572-8a8d-2e3ac599b7fc" status: 200 len: 1466 microversion: 2.1 time: 0.253854 Feb 17 04:54:14.208522 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 578/1159] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:54:13 2021] GET /compute/v2.1/servers/58e29ec6-b1ea-4572-8a8d-2e3ac599b7fc => generated 1466 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:54:15.228378 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-7ce08a6c-5d08-4aae-9507-5b46321f0678 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:54:15.229029 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-7ce08a6c-5d08-4aae-9507-5b46321f0678 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] [instance: 58e29ec6-b1ea-4572-8a8d-2e3ac599b7fc] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:54:15.238021 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7ce08a6c-5d08-4aae-9507-5b46321f0678 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:54:15.238972 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7ce08a6c-5d08-4aae-9507-5b46321f0678 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:54:15.239569 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7ce08a6c-5d08-4aae-9507-5b46321f0678 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:54:15.239915 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-7ce08a6c-5d08-4aae-9507-5b46321f0678 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:54:15.297095 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [req-474b1f73-d5f2-4a1e-956e-e4ebd5b9ae60 req-f9c74c64-78f0-4afe-a1ff-5e92145318ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58e29ec6-b1ea-4572-8a8d-2e3ac599b7fc", "name": "network-vif-deleted", "tag": "94a0a043-61c1-452f-8790-f62c52b0bb57"}]} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:54:15.299723 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:54:15.299723 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:54:15.312526 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-474b1f73-d5f2-4a1e-956e-e4ebd5b9ae60 req-f9c74c64-78f0-4afe-a1ff-5e92145318ed service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:54:15.313267 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-474b1f73-d5f2-4a1e-956e-e4ebd5b9ae60 req-f9c74c64-78f0-4afe-a1ff-5e92145318ed service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:54:15.339059 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.compute.server_external_events [req-474b1f73-d5f2-4a1e-956e-e4ebd5b9ae60 req-f9c74c64-78f0-4afe-a1ff-5e92145318ed service nova] Creating event network-vif-deleted:94a0a043-61c1-452f-8790-f62c52b0bb57 for instance 58e29ec6-b1ea-4572-8a8d-2e3ac599b7fc on hv-cinder-76019 Feb 17 04:54:15.345467 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [req-474b1f73-d5f2-4a1e-956e-e4ebd5b9ae60 req-f9c74c64-78f0-4afe-a1ff-5e92145318ed service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054089 Feb 17 04:54:15.346389 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 579/1160] 10.222.0.38 () {64 vars in 1308 bytes} [Wed Feb 17 04:54:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:54:15.386956 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-7ce08a6c-5d08-4aae-9507-5b46321f0678 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f25433642c4ea1996f8b1da7bf21d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cb524e7a8d4981b00474e1d9ed2062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:54:15.396822 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-7ce08a6c-5d08-4aae-9507-5b46321f0678 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] 10.222.0.38 "GET /compute/v2.1/servers/58e29ec6-b1ea-4572-8a8d-2e3ac599b7fc" status: 200 len: 1391 microversion: 2.1 time: 0.172528 Feb 17 04:54:15.397434 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 582/1161] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:54:15 2021] GET /compute/v2.1/servers/58e29ec6-b1ea-4572-8a8d-2e3ac599b7fc => generated 1391 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:54:16.422859 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-634d1c04-4d1b-4c92-85a0-4a36ad822614 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:54:16.423803 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-634d1c04-4d1b-4c92-85a0-4a36ad822614 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] [instance: 58e29ec6-b1ea-4572-8a8d-2e3ac599b7fc] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:54:16.434907 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-634d1c04-4d1b-4c92-85a0-4a36ad822614 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:54:16.435590 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-634d1c04-4d1b-4c92-85a0-4a36ad822614 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:54:16.436643 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-634d1c04-4d1b-4c92-85a0-4a36ad822614 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:54:16.437154 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-634d1c04-4d1b-4c92-85a0-4a36ad822614 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:54:16.513012 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.wsgi [None req-634d1c04-4d1b-4c92-85a0-4a36ad822614 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] HTTP exception thrown: Instance 58e29ec6-b1ea-4572-8a8d-2e3ac599b7fc could not be found. Feb 17 04:54:16.513917 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-634d1c04-4d1b-4c92-85a0-4a36ad822614 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Returning 404 to user: Instance 58e29ec6-b1ea-4572-8a8d-2e3ac599b7fc could not be found. {{(pid=98080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:54:16.515184 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-634d1c04-4d1b-4c92-85a0-4a36ad822614 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] 10.222.0.38 "GET /compute/v2.1/servers/58e29ec6-b1ea-4572-8a8d-2e3ac599b7fc" status: 404 len: 111 microversion: 2.1 time: 0.098629 Feb 17 04:54:16.516014 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 580/1162] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:54:16 2021] GET /compute/v2.1/servers/58e29ec6-b1ea-4572-8a8d-2e3ac599b7fc => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:54:18.950109 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-28ab914b-d72e-40fc-afe6-28e724bdfaa5 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Calling method '.version_select at 0x7fc2e9e0d0d0>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:54:19.453256 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-28ab914b-d72e-40fc-afe6-28e724bdfaa5 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] [instance: 28c06dc3-0b56-4809-9026-1eaf9480095b] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:54:19.461262 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-28ab914b-d72e-40fc-afe6-28e724bdfaa5 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:54:19.461781 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-28ab914b-d72e-40fc-afe6-28e724bdfaa5 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:54:19.462666 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-28ab914b-d72e-40fc-afe6-28e724bdfaa5 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:54:19.463171 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-28ab914b-d72e-40fc-afe6-28e724bdfaa5 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:54:19.531319 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-28ab914b-d72e-40fc-afe6-28e724bdfaa5 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Acquired lock "refresh_cache-28c06dc3-0b56-4809-9026-1eaf9480095b" {{(pid=98081) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Feb 17 04:54:21.516360 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.network.neutron [None req-28ab914b-d72e-40fc-afe6-28e724bdfaa5 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] [instance: 28c06dc3-0b56-4809-9026-1eaf9480095b] Building network info cache for instance {{(pid=98081) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1836}} Feb 17 04:54:21.525706 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [req-f20af0ea-f984-4af4-a9cd-88d6bbad9676 req-76ec88d4-e7f2-4297-9fd8-ccf12dd1f06f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28c06dc3-0b56-4809-9026-1eaf9480095b", "tag": "aaba6df2-825a-4e72-abaf-91c6289d2624"}]} {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:54:21.527638 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:54:21.527638 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:54:21.536518 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-f20af0ea-f984-4af4-a9cd-88d6bbad9676 req-76ec88d4-e7f2-4297-9fd8-ccf12dd1f06f service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:54:21.537028 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-f20af0ea-f984-4af4-a9cd-88d6bbad9676 req-76ec88d4-e7f2-4297-9fd8-ccf12dd1f06f service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:54:21.554793 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.compute.server_external_events [req-f20af0ea-f984-4af4-a9cd-88d6bbad9676 req-76ec88d4-e7f2-4297-9fd8-ccf12dd1f06f service nova] Creating event network-changed:aaba6df2-825a-4e72-abaf-91c6289d2624 for instance 28c06dc3-0b56-4809-9026-1eaf9480095b on hv-cinder-76019 Feb 17 04:54:21.560810 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [req-f20af0ea-f984-4af4-a9cd-88d6bbad9676 req-76ec88d4-e7f2-4297-9fd8-ccf12dd1f06f service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039035 Feb 17 04:54:21.561640 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 581/1163] 10.222.0.38 () {64 vars in 1308 bytes} [Wed Feb 17 04:54:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:54:22.949712 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.network.neutron [None req-28ab914b-d72e-40fc-afe6-28e724bdfaa5 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] [instance: 28c06dc3-0b56-4809-9026-1eaf9480095b] Updating instance_info_cache with network_info: [{"id": "aaba6df2-825a-4e72-abaf-91c6289d2624", "address": "fa:16:3e:12:66:1f", "network": {"id": "a877ef56-9526-4e88-a555-4c4a4c974334", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-239973466-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "01cb524e7a8d4981b00474e1d9ed2062", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tapaaba6df2-82", "ovs_interfaceid": "aaba6df2-825a-4e72-abaf-91c6289d2624", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=98081) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Feb 17 04:54:22.966180 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-28ab914b-d72e-40fc-afe6-28e724bdfaa5 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Releasing lock "refresh_cache-28c06dc3-0b56-4809-9026-1eaf9480095b" {{(pid=98081) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Feb 17 04:54:22.967166 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-28ab914b-d72e-40fc-afe6-28e724bdfaa5 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] 10.222.0.38 "DELETE /compute/v2.1/os-floating-ips/a22a3f5c-042d-4624-ab20-026a957b2cdb" status: 202 len: 0 microversion: 2.1 time: 4.021999 Feb 17 04:54:22.970608 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 583/1164] 10.222.0.38 () {58 vars in 1253 bytes} [Wed Feb 17 04:54:18 2021] DELETE /compute/v2.1/os-floating-ips/a22a3f5c-042d-4624-ab20-026a957b2cdb => generated 0 bytes in 4023 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:54:22.977942 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-edeef47f-ac24-46eb-9d4c-6a45c6c64664 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:54:22.978753 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-edeef47f-ac24-46eb-9d4c-6a45c6c64664 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] [instance: 28c06dc3-0b56-4809-9026-1eaf9480095b] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:54:22.987984 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-edeef47f-ac24-46eb-9d4c-6a45c6c64664 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:54:22.988582 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-edeef47f-ac24-46eb-9d4c-6a45c6c64664 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:54:22.989659 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-edeef47f-ac24-46eb-9d4c-6a45c6c64664 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:54:22.990382 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-edeef47f-ac24-46eb-9d4c-6a45c6c64664 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:54:23.057816 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-edeef47f-ac24-46eb-9d4c-6a45c6c64664 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] [instance: 28c06dc3-0b56-4809-9026-1eaf9480095b] Going to try to terminate instance {{(pid=98080) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 04:54:23.181569 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-edeef47f-ac24-46eb-9d4c-6a45c6c64664 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] 10.222.0.38 "DELETE /compute/v2.1/servers/28c06dc3-0b56-4809-9026-1eaf9480095b" status: 204 len: 0 microversion: 2.1 time: 0.208160 Feb 17 04:54:23.186005 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 582/1165] 10.222.0.38 () {58 vars in 1229 bytes} [Wed Feb 17 04:54:22 2021] DELETE /compute/v2.1/servers/28c06dc3-0b56-4809-9026-1eaf9480095b => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 17 04:54:23.191519 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-3b88cf9e-7fbd-40df-a489-f958eb0d3fc3 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:54:23.192310 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-3b88cf9e-7fbd-40df-a489-f958eb0d3fc3 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] [instance: 28c06dc3-0b56-4809-9026-1eaf9480095b] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:54:23.200928 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-3b88cf9e-7fbd-40df-a489-f958eb0d3fc3 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:54:23.201374 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-3b88cf9e-7fbd-40df-a489-f958eb0d3fc3 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:54:23.202433 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-3b88cf9e-7fbd-40df-a489-f958eb0d3fc3 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:54:23.203169 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-3b88cf9e-7fbd-40df-a489-f958eb0d3fc3 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:54:23.611770 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-3b88cf9e-7fbd-40df-a489-f958eb0d3fc3 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f25433642c4ea1996f8b1da7bf21d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cb524e7a8d4981b00474e1d9ed2062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98081) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:54:23.620864 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-3b88cf9e-7fbd-40df-a489-f958eb0d3fc3 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] 10.222.0.38 "GET /compute/v2.1/servers/28c06dc3-0b56-4809-9026-1eaf9480095b" status: 200 len: 1467 microversion: 2.1 time: 0.433380 Feb 17 04:54:23.621469 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 584/1166] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:54:23 2021] GET /compute/v2.1/servers/28c06dc3-0b56-4809-9026-1eaf9480095b => generated 1467 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:54:24.641891 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-ec13b0ab-f67b-44e1-8f06-0b8d4fdf3bae tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:54:24.642685 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-ec13b0ab-f67b-44e1-8f06-0b8d4fdf3bae tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] [instance: 28c06dc3-0b56-4809-9026-1eaf9480095b] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:54:24.650414 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ec13b0ab-f67b-44e1-8f06-0b8d4fdf3bae tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:54:24.650966 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ec13b0ab-f67b-44e1-8f06-0b8d4fdf3bae tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:54:24.652369 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ec13b0ab-f67b-44e1-8f06-0b8d4fdf3bae tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:54:24.652959 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ec13b0ab-f67b-44e1-8f06-0b8d4fdf3bae tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:54:25.357621 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [req-5c0dfc48-2c6d-4ae8-8e33-85fc6e4ba8ad req-a0a717da-7435-492c-9aee-bf7401714e19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28c06dc3-0b56-4809-9026-1eaf9480095b", "name": "network-vif-unplugged", "status": "completed", "tag": "aaba6df2-825a-4e72-abaf-91c6289d2624"}]} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:54:25.360188 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:54:25.360188 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:54:25.370794 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-5c0dfc48-2c6d-4ae8-8e33-85fc6e4ba8ad req-a0a717da-7435-492c-9aee-bf7401714e19 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:54:25.371304 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-5c0dfc48-2c6d-4ae8-8e33-85fc6e4ba8ad req-a0a717da-7435-492c-9aee-bf7401714e19 service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:54:25.390724 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.compute.server_external_events [req-5c0dfc48-2c6d-4ae8-8e33-85fc6e4ba8ad req-a0a717da-7435-492c-9aee-bf7401714e19 service nova] Creating event network-vif-unplugged:aaba6df2-825a-4e72-abaf-91c6289d2624 for instance 28c06dc3-0b56-4809-9026-1eaf9480095b on hv-cinder-76019 Feb 17 04:54:25.396016 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [req-5c0dfc48-2c6d-4ae8-8e33-85fc6e4ba8ad req-a0a717da-7435-492c-9aee-bf7401714e19 service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043680 Feb 17 04:54:25.397103 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 585/1167] 10.222.0.38 () {64 vars in 1308 bytes} [Wed Feb 17 04:54:25 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 04:54:25.413201 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-ec13b0ab-f67b-44e1-8f06-0b8d4fdf3bae tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f25433642c4ea1996f8b1da7bf21d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cb524e7a8d4981b00474e1d9ed2062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:54:25.424548 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-ec13b0ab-f67b-44e1-8f06-0b8d4fdf3bae tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] 10.222.0.38 "GET /compute/v2.1/servers/28c06dc3-0b56-4809-9026-1eaf9480095b" status: 200 len: 1467 microversion: 2.1 time: 0.787015 Feb 17 04:54:25.425456 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 583/1168] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:54:24 2021] GET /compute/v2.1/servers/28c06dc3-0b56-4809-9026-1eaf9480095b => generated 1467 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:54:26.113581 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [req-c8553cd1-d0d9-4065-bb10-b08d696d6d7a req-e2b8b05e-b9bd-44c8-88e4-ea45d06fca2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28c06dc3-0b56-4809-9026-1eaf9480095b", "name": "network-vif-deleted", "tag": "aaba6df2-825a-4e72-abaf-91c6289d2624"}]} {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 04:54:26.116098 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 04:54:26.116098 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: warnings.warn(msg) Feb 17 04:54:26.127603 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-c8553cd1-d0d9-4065-bb10-b08d696d6d7a req-e2b8b05e-b9bd-44c8-88e4-ea45d06fca2e service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:54:26.128368 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [req-c8553cd1-d0d9-4065-bb10-b08d696d6d7a req-e2b8b05e-b9bd-44c8-88e4-ea45d06fca2e service nova] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:54:26.147614 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.compute.server_external_events [req-c8553cd1-d0d9-4065-bb10-b08d696d6d7a req-e2b8b05e-b9bd-44c8-88e4-ea45d06fca2e service nova] Creating event network-vif-deleted:aaba6df2-825a-4e72-abaf-91c6289d2624 for instance 28c06dc3-0b56-4809-9026-1eaf9480095b on hv-cinder-76019 Feb 17 04:54:26.153814 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [req-c8553cd1-d0d9-4065-bb10-b08d696d6d7a req-e2b8b05e-b9bd-44c8-88e4-ea45d06fca2e service nova] 10.222.0.38 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044747 Feb 17 04:54:26.154461 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 586/1169] 10.222.0.38 () {64 vars in 1308 bytes} [Wed Feb 17 04:54:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 04:54:26.445661 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-5d59e689-15e9-4b74-bd77-20a4e17d54ce tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:54:26.446433 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-5d59e689-15e9-4b74-bd77-20a4e17d54ce tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] [instance: 28c06dc3-0b56-4809-9026-1eaf9480095b] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:54:26.455778 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5d59e689-15e9-4b74-bd77-20a4e17d54ce tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:54:26.456293 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5d59e689-15e9-4b74-bd77-20a4e17d54ce tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:54:26.457295 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5d59e689-15e9-4b74-bd77-20a4e17d54ce tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:54:26.457633 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-5d59e689-15e9-4b74-bd77-20a4e17d54ce tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:54:26.613929 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.policy [None req-5d59e689-15e9-4b74-bd77-20a4e17d54ce tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75f25433642c4ea1996f8b1da7bf21d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cb524e7a8d4981b00474e1d9ed2062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98080) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 04:54:26.623313 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-5d59e689-15e9-4b74-bd77-20a4e17d54ce tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] 10.222.0.38 "GET /compute/v2.1/servers/28c06dc3-0b56-4809-9026-1eaf9480095b" status: 200 len: 1226 microversion: 2.1 time: 0.181680 Feb 17 04:54:26.624058 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 584/1170] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:54:26 2021] GET /compute/v2.1/servers/28c06dc3-0b56-4809-9026-1eaf9480095b => generated 1226 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 04:54:27.642348 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-ef97af3b-b438-45b3-a8e1-907685179a8d tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:54:27.643187 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-ef97af3b-b438-45b3-a8e1-907685179a8d tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] [instance: 28c06dc3-0b56-4809-9026-1eaf9480095b] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:54:27.651801 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ef97af3b-b438-45b3-a8e1-907685179a8d tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:54:27.652519 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ef97af3b-b438-45b3-a8e1-907685179a8d tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:54:27.653360 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ef97af3b-b438-45b3-a8e1-907685179a8d tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:54:27.653857 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-ef97af3b-b438-45b3-a8e1-907685179a8d tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:54:27.707724 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.wsgi [None req-ef97af3b-b438-45b3-a8e1-907685179a8d tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] HTTP exception thrown: Instance 28c06dc3-0b56-4809-9026-1eaf9480095b could not be found. Feb 17 04:54:27.708391 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-ef97af3b-b438-45b3-a8e1-907685179a8d tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Returning 404 to user: Instance 28c06dc3-0b56-4809-9026-1eaf9480095b could not be found. {{(pid=98081) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:54:27.710015 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-ef97af3b-b438-45b3-a8e1-907685179a8d tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] 10.222.0.38 "GET /compute/v2.1/servers/28c06dc3-0b56-4809-9026-1eaf9480095b" status: 404 len: 111 microversion: 2.1 time: 0.072288 Feb 17 04:54:27.710855 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 587/1171] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:54:27 2021] GET /compute/v2.1/servers/28c06dc3-0b56-4809-9026-1eaf9480095b => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:54:27.722849 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-835e284b-c03e-4d4d-98d9-2a65385a9dc3 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Calling method '.version_select at 0x7fc2e96c9ea0>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:54:29.133357 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-835e284b-c03e-4d4d-98d9-2a65385a9dc3 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] 10.222.0.38 "DELETE /compute/v2.1/os-floating-ips/169d21d7-3c48-44f9-89f1-83d8738d7e24" status: 202 len: 0 microversion: 2.1 time: 1.416481 Feb 17 04:54:29.134001 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 585/1172] 10.222.0.38 () {58 vars in 1253 bytes} [Wed Feb 17 04:54:27 2021] DELETE /compute/v2.1/os-floating-ips/169d21d7-3c48-44f9-89f1-83d8738d7e24 => generated 0 bytes in 1418 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:54:29.143535 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-0d737206-87b4-4667-be66-57e5667237a5 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Calling method '>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:54:29.144148 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-0d737206-87b4-4667-be66-57e5667237a5 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] [instance: ed61fd7e-829e-4928-8dc9-4597d4d49aec] Fetching instance by UUID {{(pid=98081) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:54:29.154082 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0d737206-87b4-4667-be66-57e5667237a5 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:54:29.154609 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0d737206-87b4-4667-be66-57e5667237a5 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:54:29.155444 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0d737206-87b4-4667-be66-57e5667237a5 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:54:29.155931 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-0d737206-87b4-4667-be66-57e5667237a5 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98081) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:54:29.210432 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.wsgi [None req-0d737206-87b4-4667-be66-57e5667237a5 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] HTTP exception thrown: Instance ed61fd7e-829e-4928-8dc9-4597d4d49aec could not be found. Feb 17 04:54:29.211131 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-0d737206-87b4-4667-be66-57e5667237a5 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Returning 404 to user: Instance ed61fd7e-829e-4928-8dc9-4597d4d49aec could not be found. {{(pid=98081) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:54:29.212018 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-0d737206-87b4-4667-be66-57e5667237a5 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] 10.222.0.38 "DELETE /compute/v2.1/servers/ed61fd7e-829e-4928-8dc9-4597d4d49aec" status: 404 len: 111 microversion: 2.1 time: 0.073227 Feb 17 04:54:29.212604 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 588/1173] 10.222.0.38 () {58 vars in 1229 bytes} [Wed Feb 17 04:54:29 2021] DELETE /compute/v2.1/servers/ed61fd7e-829e-4928-8dc9-4597d4d49aec => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:54:29.222001 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-4d3a9596-447e-4546-964b-04c1aa2e3bff tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Calling method '>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:54:29.222701 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.compute.api [None req-4d3a9596-447e-4546-964b-04c1aa2e3bff tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] [instance: ed61fd7e-829e-4928-8dc9-4597d4d49aec] Fetching instance by UUID {{(pid=98080) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 04:54:29.232044 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4d3a9596-447e-4546-964b-04c1aa2e3bff tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:54:29.232562 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4d3a9596-447e-4546-964b-04c1aa2e3bff tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:54:29.233416 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4d3a9596-447e-4546-964b-04c1aa2e3bff tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 04:54:29.233919 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG oslo_concurrency.lockutils [None req-4d3a9596-447e-4546-964b-04c1aa2e3bff tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Lock "cae8762b-f9db-4634-9f99-cd5d65b514f3" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98080) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 04:54:29.286503 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.wsgi [None req-4d3a9596-447e-4546-964b-04c1aa2e3bff tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] HTTP exception thrown: Instance ed61fd7e-829e-4928-8dc9-4597d4d49aec could not be found. Feb 17 04:54:29.287164 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-4d3a9596-447e-4546-964b-04c1aa2e3bff tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Returning 404 to user: Instance ed61fd7e-829e-4928-8dc9-4597d4d49aec could not be found. {{(pid=98080) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 04:54:29.288076 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-4d3a9596-447e-4546-964b-04c1aa2e3bff tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] 10.222.0.38 "GET /compute/v2.1/servers/ed61fd7e-829e-4928-8dc9-4597d4d49aec" status: 404 len: 111 microversion: 2.1 time: 0.070249 Feb 17 04:54:29.288689 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 586/1174] 10.222.0.38 () {58 vars in 1226 bytes} [Wed Feb 17 04:54:29 2021] GET /compute/v2.1/servers/ed61fd7e-829e-4928-8dc9-4597d4d49aec => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 04:54:30.549487 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-e2f77894-273f-4325-98f3-3c33afc673d0 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Calling method '.version_select at 0x7fc2e9dd9b70>' {{(pid=98081) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:54:30.802517 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-e2f77894-273f-4325-98f3-3c33afc673d0 tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] 10.222.0.38 "DELETE /compute/v2.1/os-security-groups/0d6c5764-0a4b-4bdf-9c66-dbe465e68a73" status: 202 len: 0 microversion: 2.1 time: 0.256951 Feb 17 04:54:30.803323 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98081|app: 0|req: 589/1175] 10.222.0.38 () {58 vars in 1262 bytes} [Wed Feb 17 04:54:30 2021] DELETE /compute/v2.1/os-security-groups/0d6c5764-0a4b-4bdf-9c66-dbe465e68a73 => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:54:30.813474 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: DEBUG nova.api.openstack.wsgi [None req-0187b9b4-e42f-4e91-be3b-57bec298cb3f tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] Calling method '.version_select at 0x7fc2ea9edb70>' {{(pid=98080) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 04:54:30.819778 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0187b9b4-e42f-4e91-be3b-57bec298cb3f tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] [0b616a04-dc25-4dd9-8ea1-b01e15de92c5] AMQP server on 10.222.0.38:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Feb 17 04:54:31.833917 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO oslo.messaging._drivers.impl_rabbit [None req-0187b9b4-e42f-4e91-be3b-57bec298cb3f tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] [0b616a04-dc25-4dd9-8ea1-b01e15de92c5] Reconnected to AMQP server on 10.222.0.38:5672 via [amqp] client with port 58522. Feb 17 04:54:31.852879 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO nova.api.openstack.requestlog [None req-0187b9b4-e42f-4e91-be3b-57bec298cb3f tempest-TestVolumeBootPattern-1538710703 tempest-TestVolumeBootPattern-1538710703-project] 10.222.0.38 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2057480649" status: 202 len: 0 microversion: 2.1 time: 1.044588 Feb 17 04:54:31.853537 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: [pid: 98080|app: 0|req: 587/1176] 10.222.0.38 () {58 vars in 1253 bytes} [Wed Feb 17 04:54:30 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2057480649 => generated 0 bytes in 1046 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 04:56:26.118720 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 17 04:56:26.119275 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: Wed Feb 17 04:56:26 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 17 04:56:49.969350 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 17 04:56:49.969855 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: Wed Feb 17 04:56:49 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 17 04:56:52.114677 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 17 04:56:52.115178 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: Wed Feb 17 04:56:52 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 17 04:57:32.073539 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 17 04:57:32.074052 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: Wed Feb 17 04:57:32 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 17 04:58:04.661875 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 17 04:58:04.662372 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: Wed Feb 17 04:58:04 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 17 04:59:46.136656 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 17 04:59:46.137234 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: Wed Feb 17 04:59:46 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 17 04:59:57.058230 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 17 04:59:57.058831 dv-cinder-760197-3-iscsi devstack@n-api.service[98078]: Wed Feb 17 04:59:57 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!